-- Logs begin at Fri 2022-10-21 20:43:44 UTC, end at Fri 2022-10-21 21:37:26 UTC. -- Oct 21 21:07:02.516463 dv-cinder-861566-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 21 21:07:02.524306 dv-cinder-861566-4-smb devstack@keystone.service[81337]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 21 21:07:02.526309 dv-cinder-861566-4-smb devstack@keystone.service[81337]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 21 21:07:02 2022] *** Oct 21 21:07:02.526309 dv-cinder-861566-4-smb devstack@keystone.service[81337]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 21 21:07:02.526309 dv-cinder-861566-4-smb devstack@keystone.service[81337]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 21 21:07:02.526309 dv-cinder-861566-4-smb devstack@keystone.service[81337]: nodename: dv-cinder-861566-4-smb Oct 21 21:07:02.526309 dv-cinder-861566-4-smb devstack@keystone.service[81337]: machine: x86_64 Oct 21 21:07:02.526309 dv-cinder-861566-4-smb devstack@keystone.service[81337]: clock source: unix Oct 21 21:07:02.526309 dv-cinder-861566-4-smb devstack@keystone.service[81337]: pcre jit disabled Oct 21 21:07:02.526755 dv-cinder-861566-4-smb devstack@keystone.service[81337]: detected number of CPU cores: 4 Oct 21 21:07:02.526755 dv-cinder-861566-4-smb devstack@keystone.service[81337]: current working directory: / Oct 21 21:07:02.526755 dv-cinder-861566-4-smb devstack@keystone.service[81337]: detected binary path: /usr/bin/uwsgi-core Oct 21 21:07:02.526755 dv-cinder-861566-4-smb devstack@keystone.service[81337]: your processes number limit is 47680 Oct 21 21:07:02.526755 dv-cinder-861566-4-smb devstack@keystone.service[81337]: your memory page size is 4096 bytes Oct 21 21:07:02.526755 dv-cinder-861566-4-smb devstack@keystone.service[81337]: detected max file descriptor number: 2048 Oct 21 21:07:02.526755 dv-cinder-861566-4-smb devstack@keystone.service[81337]: lock engine: pthread robust mutexes Oct 21 21:07:02.526755 dv-cinder-861566-4-smb devstack@keystone.service[81337]: thunder lock: enabled Oct 21 21:07:02.526755 dv-cinder-861566-4-smb devstack@keystone.service[81337]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 21 21:07:02.526755 dv-cinder-861566-4-smb devstack@keystone.service[81337]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 21 21:07:02.566844 dv-cinder-861566-4-smb devstack@keystone.service[81337]: Python main interpreter initialized at 0x55d7735309c0 Oct 21 21:07:02.566844 dv-cinder-861566-4-smb devstack@keystone.service[81337]: python threads support enabled Oct 21 21:07:02.566844 dv-cinder-861566-4-smb devstack@keystone.service[81337]: your server socket listen backlog is limited to 100 connections Oct 21 21:07:02.566844 dv-cinder-861566-4-smb devstack@keystone.service[81337]: your mercy for graceful operations on workers is 90 seconds Oct 21 21:07:02.567220 dv-cinder-861566-4-smb devstack@keystone.service[81337]: mapped 403077 bytes (393 KB) for 2 cores Oct 21 21:07:02.567326 dv-cinder-861566-4-smb devstack@keystone.service[81337]: *** Operational MODE: preforking *** Oct 21 21:07:02.567578 dv-cinder-861566-4-smb devstack@keystone.service[81337]: *** uWSGI is running in multiple interpreter mode *** Oct 21 21:07:02.567578 dv-cinder-861566-4-smb devstack@keystone.service[81337]: spawned uWSGI master process (pid: 81337) Oct 21 21:07:02.567778 dv-cinder-861566-4-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 21 21:07:02.568550 dv-cinder-861566-4-smb devstack@keystone.service[81337]: spawned uWSGI worker 1 (pid: 81347, cores: 1) Oct 21 21:07:02.568650 dv-cinder-861566-4-smb devstack@keystone.service[81337]: spawned uWSGI worker 2 (pid: 81348, cores: 1) Oct 21 21:07:02.569040 dv-cinder-861566-4-smb devstack@keystone.service[81337]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 21 21:07:06.832710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 21:07:06.832710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: from cryptography.utils import int_from_bytes Oct 21 21:07:06.833503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 21:07:06.833503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: from cryptography.utils import int_from_bytes Oct 21 21:07:06.833621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 21:07:06.833621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: from cryptography.utils import int_from_bytes Oct 21 21:07:06.833621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 21 21:07:06.833621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: from cryptography.utils import int_from_bytes Oct 21 21:07:06.882550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 21 21:07:06.882746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 21 21:07:06.882941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] command line args: [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 21 21:07:06.883166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 21 21:07:06.883253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 21 21:07:06.883388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 21 21:07:06.883473 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ================================================================================ {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 21 21:07:06.883586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] command line args: [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 21 21:07:06.883671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] admin_token = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.883861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 21 21:07:06.883942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] config_dir = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.884042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ================================================================================ {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 21 21:07:06.884127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.884228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] config_source = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.884309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] admin_token = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.884412 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] debug = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.884541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] config_dir = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.884624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.884855 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.884924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] config_source = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.884986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.885126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] debug = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.885205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.885277 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.885365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.885507 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.885620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.885722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.885827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.885932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.886026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_config_append = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.886167 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.886274 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.886367 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_dir = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.886467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.886567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_file = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.886660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_config_append = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.886759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.886852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.886928 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_dir = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.887051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.887132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_file = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.887244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.887377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.887450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.887566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.887654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.887793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.887876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.888039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.888122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.888223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.888301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.888417 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.888497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.888640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.888732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.888889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.888967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.889126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.889248 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.889362 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.889438 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.889597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.889723 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.889834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.889918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.890084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.890332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.890416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.890564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] publish_errors = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.890680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.890774 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.891004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.891085 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.891250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.891384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] publish_errors = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.891466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.891536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.891685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.891764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.891890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.891978 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] standard_threads = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.892140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.892222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.892374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.892450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.892551 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.892627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] standard_threads = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.892731 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] use_journal = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.892830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.892912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] use_json = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.893073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] use_stderr = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.893216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.893290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.893363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] use_syslog = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.893433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] use_journal = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.893506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.893575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] use_json = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.893714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.894299 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] use_stderr = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.894477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] use_syslog = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.894553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.894713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 21 21:07:06.894821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.894970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.895053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.895215 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.895332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.895507 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.895582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.895749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.895828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.896002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.896078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.896243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.896320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.896495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.896578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.896736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.896813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.896975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.897050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.897223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.897303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.897458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.897533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.897709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.897785 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.897960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.898044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.898199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.898284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.898464 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.898545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.898711 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.898794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.898951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.899028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.899186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.899261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.899456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.899531 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.899709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.899793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.899947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.900032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.900203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.900278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.900439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.900521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.900674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.900760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.900909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.900986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.901149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.901224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.901382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.901468 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.901615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.901697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.901853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.901929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.902087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.902182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.902337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.902473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.902568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.902643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.902800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.902885 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.903050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.903126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.903293 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.903378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.903543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.903631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.903781 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.903864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.904010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.904086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.904240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.904327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.904474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.904550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.904704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.904785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.904961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.905118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.905237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.905310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.905385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.905455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.905620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.905705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.905855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.905931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.906091 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.906176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.906327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.906411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.906559 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.906634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.906798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.906873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.907036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.907118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.907293 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.907373 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.907528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.907613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.907766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.907850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.908002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.908078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.908232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.908346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.908452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.908546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.908691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.908809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.908926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.909030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.909143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.909260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.909447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.910057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.910217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.910297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.910456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.910575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.910701 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.910790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.910942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.911019 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.911173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.911257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.911440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.911527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.911681 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.911801 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.911951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.912029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.912191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.912308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.912433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.912509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.912675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.912760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.912913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.912990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.913149 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.913229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.913388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.913511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.913633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.913710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.913873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.914001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.914131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.914252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.914382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.914511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.914632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.914756 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.914883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.915008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.915141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.915329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.915467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.915598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.915598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.915833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.915965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.916091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.916216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.916339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.916463 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.916586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.916718 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.916842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.916963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.917087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.917223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.917347 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.917546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.917671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.917671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.917905 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.918028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.918163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.918297 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.918428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.918553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.918676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.918800 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.918924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.919057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.919193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.919193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.919445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.919564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.919692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.919817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.919951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.920076 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.920200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.920324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.920453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.920577 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.920721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.920843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.920918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.920996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.external = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.external = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.password = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.token = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.921960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.922028 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.password = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.922138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.922215 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.token = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.922295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.922391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.922470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.922631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.922710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.922883 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.922973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.923118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.923195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.923389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.923473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.923638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.923727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.923874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.923952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.924111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.924190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.924361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.924447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.924606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.924690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.924848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.924926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.925126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.925212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.925394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.925512 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.925621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.925700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.925873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.925959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.926132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.926210 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.926371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.926449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.926628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.926714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.926873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.926949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.927134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.927211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.927399 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.927491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.927645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.927724 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.927898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.927983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.928133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.928219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.928373 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.928449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.928621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.928697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.928860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.928945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.929093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.929170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.929344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.929420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.929585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.929663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.929832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.929908 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.930068 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.930143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.930312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.930395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.930552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.930628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.930803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.930887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.931097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.931174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.931297 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.931378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.931540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.931618 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.931776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.931856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.932012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.932088 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.932264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.932377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.932518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.932617 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.932753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.932864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.932989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.933121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.933207 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.933376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.933454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.933613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.933691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.933851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.933937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.934087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.934164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.934337 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.934414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.934589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.934675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.934843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.934921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.935102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.935182 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.935363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.935456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.935609 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.935687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.935846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.935923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.936100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.936185 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.936337 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.936415 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.936579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.936664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.936813 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.936899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.937053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.937132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.937297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.937374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.937540 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.937628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.937792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.937870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.938027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.938111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.938279 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.938373 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.938526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.938603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.938764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.938841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.938997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.939082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.939241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.939423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.939494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.939597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.939728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.939809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.939962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.940039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.940202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.940278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.940441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.940518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.940719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.940800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.940956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.941034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.941192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.941271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.941440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.941516 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.941689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.941766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.941922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.942005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.942157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.942234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.942395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.942471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.942631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.942709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.942871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.942946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.943109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.943195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.943371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.943453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.943608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.943686 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.943850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.943929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.944098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.944175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.944332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.944409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.944562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.944639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.944803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.944882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.945041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.945119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.945280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.945357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.945511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.945588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.945749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.945827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.945986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.946064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.946224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.946303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.946458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.946536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.946956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.947040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.947191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.947286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.947466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.947545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.947707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.947785 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.947947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.948026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.948177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.948254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.948419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.948496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.948655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.948733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.948893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.948970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.949131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.949208 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.949369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.949447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.949606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.949684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.949855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.949939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.950092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.950176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.950328 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.950405 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.950570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.950646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.950819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.950897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.951058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.951143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.951304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.951386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.951549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.951629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.951792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.951870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.952034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.952110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.952271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.952349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.952507 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.952583 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.952747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.952823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.952998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.953076 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.953238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.953315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.953473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.953549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.953715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.953792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.953958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.954035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.954193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.954269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] role.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.954442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] role.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.954522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.954676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.954754 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.954913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.954997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.955154 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] role.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.955232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.955428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] role.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.955508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.955663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.955753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.955913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.955991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.956160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.956237 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.956934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.957022 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.957187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.957266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.957421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.957498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.957671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.957756 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.957918 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.957995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.958165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.958248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.958396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.958480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.958646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.958798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.958898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.959044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.959147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.959318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.959426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.959577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.959818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.959896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.960057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.960147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.960290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.960368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.960547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.960625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.960796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.960874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.961035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.961111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.961271 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.961413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.961499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.961571 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.961727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.961805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.961981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.962065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.962221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.962325 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.962457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.962573 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.962715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.962957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.963101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.963230 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.963372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.963498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.963677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.963858 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.964001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.964128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.964253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.964380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.964505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.964629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.964762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.964887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.965013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.965137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.965262 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.965388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.965579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.965702 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.965838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.965964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.966089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.966213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.966346 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.966473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.966598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.966722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.966846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.966970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.967106 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.967243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.967428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.967589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.967736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.967862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.967987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.968121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.968246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.connection = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.968371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.968497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.968624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.968750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.968883 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.969008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.969133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.969266 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.969408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.969563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.969738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.969886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.970026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.connection = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.970153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.970287 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.970414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.970540 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.970667 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.970802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.970928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.971053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.971135 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.971373 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.971501 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.971591 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.971673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.971746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.971816 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.971895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.972015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.972015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.972648 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.972720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.972788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.972858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.972926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.973004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 21 21:07:06.973076 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.973076 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.973226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.973476 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.973712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.973956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.974194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 21 21:07:06.974367 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 21 21:07:07.001620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.001850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.002077 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.002477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.002711 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.002939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.010495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.011385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.040346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.040522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.040615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.040761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.093059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.093191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.142139 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.142375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.142463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.142672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.295469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.295699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.295925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.296149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.296342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.296430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.296574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.296655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.296798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.297018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.297235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.297451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.319945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.320051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.320187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.320285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.320414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.320497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.320636 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.320717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.320853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.320936 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.321066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.321148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.321279 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.321369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.333196 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.333528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.345876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.346074 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.346221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.346316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.346457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.346540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.346685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.346767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.346928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.347010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.347146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.347227 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.347397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.347619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 21 21:07:07.363776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.363991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 21 21:07:07.364209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.364335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.364416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 21 21:07:07.364540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 21 21:07:07.364753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.364836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.364957 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 21 21:07:07.365073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.365235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.365502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.365582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.365767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.365846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.366027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.375224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.375538 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.375817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.375990 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.376105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.376274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.376550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.376839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.383625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.384380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.386521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.386812 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.387099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.387306 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.387414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.387601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.387693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.387888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.387971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.388174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.388255 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.388461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.388542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.388729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.388849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.389005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.389131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.389282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.389408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.389558 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.389834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.390107 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.412447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.413285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.413913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.414204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.414749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.415037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.419724 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.420014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.420303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.420497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.420794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.421081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.426961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.427250 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.427643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.427938 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.432109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.432407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.432706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.432848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.432998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.433151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.433294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.433448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.433573 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.433743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.433856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.434025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.434140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.434307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.434581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.434857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.450483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.450771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.452065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.452354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.454662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.456162 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.458436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.458737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.459970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.460275 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.462956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.464438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.466108 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.467690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.469348 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.469653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.469958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.470260 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.470551 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.470843 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.471170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.471509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.471818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.472162 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.472454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.472738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.486558 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.486855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.487128 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.487425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.489004 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.489297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.489571 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.489838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.494770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.496349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.496710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.498025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.498260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.498345 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.499833 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.500127 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.500980 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.501276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.501672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.501963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.502258 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.502842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.503213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.504016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.504306 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.504693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.513871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.514164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.514548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.514837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.515144 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.515466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.515753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.515834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.516066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.516355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.516639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.517035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.517319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.517612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.531073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.532966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.534014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.535940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.536981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.538411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.538813 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.540062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.540320 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.540402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.540640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.541803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.542094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.542512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.546957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.548463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.548863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.550872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.552016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.552313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.552602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.552881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.553787 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.554191 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.554481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.554761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.560709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.561010 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.561299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.562567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.562866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.563159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.569596 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.569885 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.570170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.570454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.570735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.570929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 21 21:07:07.571012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.571221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.571348 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.571532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.571866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.572067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.572156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.572347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.572506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.572625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.572801 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.572904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.573081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.573212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.573353 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.573489 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.573618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.573764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.574041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.574374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.574649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.574914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 21 21:07:07.606562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7735309c0 pid: 81347 (default app) Oct 21 21:07:07.609101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7735309c0 pid: 81348 (default app) Oct 21 21:07:07.609800 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216e79d-522f-4e30-8684-fddc216ad97c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:07.610095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216e79d-522f-4e30-8684-fddc216ad97c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:07.610375 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216e79d-522f-4e30-8684-fddc216ad97c None None] PATH_INFO: `/v3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:07.615079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Fri Oct 21 21:07:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:14.323625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7cd5e-6238-4b2b-b8db-4c3b40de741c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:14.324112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7cd5e-6238-4b2b-b8db-4c3b40de741c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:14.324112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7cd5e-6238-4b2b-b8db-4c3b40de741c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:14.328386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:14.334061 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:14.334510 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:14.334643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:14.404657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: INFO dbcounter [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] Registered counter for database keystone Oct 21 21:07:14.423933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG oslo_db.sqlalchemy.engines [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 21:07:14.430080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writer thread running {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 21:07:14.613110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG passlib.handlers.bcrypt [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81347) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 21 21:07:14.613413 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG passlib.handlers.bcrypt [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81347) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 21 21:07:14.671062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:14.672707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:14.802632 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 21 21:07:15.242739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7cd5e-6238-4b2b-b8db-4c3b40de741c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:15.311981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: INFO dbcounter [None req-bba7cd5e-6238-4b2b-b8db-4c3b40de741c None None] Registered counter for database keystone Oct 21 21:07:15.334010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG oslo_db.sqlalchemy.engines [None req-bba7cd5e-6238-4b2b-b8db-4c3b40de741c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 21 21:07:15.340158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writer thread running {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 21 21:07:15.459921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7cd5e-6238-4b2b-b8db-4c3b40de741c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:15.464205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbc421-149f-482d-b637-962e1b819655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:15.464826 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbc421-149f-482d-b637-962e1b819655 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:15.465110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbc421-149f-482d-b637-962e1b819655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:15.465388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbc421-149f-482d-b637-962e1b819655 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:15.474091 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbc421-149f-482d-b637-962e1b819655 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:15.525970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WARNING keystone.common.rbac_enforcer.enforcer [None req-25cbc421-149f-482d-b637-962e1b819655 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 21 21:07:15.526398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbc421-149f-482d-b637-962e1b819655 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:15.536182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Oct 21 21:07:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:07:15.542024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:15.559019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df73a83-7e7c-45ca-bc8e-285fe2c28685 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:15.563432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1efd0-6780-4ddc-b29c-c3eda251a6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:15.564486 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1efd0-6780-4ddc-b29c-c3eda251a6ea admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:15.564768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1efd0-6780-4ddc-b29c-c3eda251a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:15.565041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1efd0-6780-4ddc-b29c-c3eda251a6ea admin admin] PATH_INFO: `/v3/projects/d513512ae6f8409d87349246d0ba49f1` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:15.569109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1efd0-6780-4ddc-b29c-c3eda251a6ea admin admin] RBAC: Authorizing `identity:get_project(project_id=d513512ae6f8409d87349246d0ba49f1)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:15.619261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ce1efd0-6780-4ddc-b29c-c3eda251a6ea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 21 21:07:15.619634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1efd0-6780-4ddc-b29c-c3eda251a6ea admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:15.624095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 21 21:07:15 2022] GET /identity/v3/projects/d513512ae6f8409d87349246d0ba49f1 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:17.733801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5cdac-240b-4fd1-af02-33008695d979 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:17.734358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5cdac-240b-4fd1-af02-33008695d979 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:17.734358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5cdac-240b-4fd1-af02-33008695d979 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:17.738428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:17.743857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be329-4bbf-4640-8c0d-65c8443a7a8c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:17.744250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be329-4bbf-4640-8c0d-65c8443a7a8c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:17.744420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be329-4bbf-4640-8c0d-65c8443a7a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:17.764619 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a56be329-4bbf-4640-8c0d-65c8443a7a8c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:17.766131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a56be329-4bbf-4640-8c0d-65c8443a7a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:17.774570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 21 21:07:18.043861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5cdac-240b-4fd1-af02-33008695d979 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:18.055951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5cdac-240b-4fd1-af02-33008695d979 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:18.060110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcc667-c652-439b-b849-313cb0ee3f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:18.060709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcc667-c652-439b-b849-313cb0ee3f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:18.060988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcc667-c652-439b-b849-313cb0ee3f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:18.061264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcc667-c652-439b-b849-313cb0ee3f30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:18.068831 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcc667-c652-439b-b849-313cb0ee3f30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:18.070581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcc667-c652-439b-b849-313cb0ee3f30 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:18.079401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Oct 21 21:07:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:07:18.085285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be329-4bbf-4640-8c0d-65c8443a7a8c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:18.094315 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be329-4bbf-4640-8c0d-65c8443a7a8c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:18.099402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b942c-9bc2-4562-9ebc-a82762887cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:18.100031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b942c-9bc2-4562-9ebc-a82762887cae admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:18.100333 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b942c-9bc2-4562-9ebc-a82762887cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:18.100613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b942c-9bc2-4562-9ebc-a82762887cae admin admin] PATH_INFO: `/v3/users/03d71d1dd5394b76991f4fa1705c829c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:18.101923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b942c-9bc2-4562-9ebc-a82762887cae admin admin] RBAC: Authorizing `identity:get_user(user_id=03d71d1dd5394b76991f4fa1705c829c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:18.103782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b942c-9bc2-4562-9ebc-a82762887cae admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:18.105295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Oct 21 21:07:18 2022] GET /identity/v3/users/03d71d1dd5394b76991f4fa1705c829c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:20.261628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44b564-3f4f-4f42-97a4-cb01e0a91cd5 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:20.262153 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44b564-3f4f-4f42-97a4-cb01e0a91cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:20.262249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44b564-3f4f-4f42-97a4-cb01e0a91cd5 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:20.263600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:07:20.268758 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bc29b-7626-4f46-8bf1-2ff40b6e8d96 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:20.269692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bc29b-7626-4f46-8bf1-2ff40b6e8d96 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:20.269825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bc29b-7626-4f46-8bf1-2ff40b6e8d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:20.288202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-428bc29b-7626-4f46-8bf1-2ff40b6e8d96 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:20.289380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-428bc29b-7626-4f46-8bf1-2ff40b6e8d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:20.314091 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf581f-e109-4378-95aa-70c682102a79 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:20.314310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf581f-e109-4378-95aa-70c682102a79 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:20.314588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf581f-e109-4378-95aa-70c682102a79 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:20.316010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:07:20.321114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf9976-0ac8-420b-9750-929b98eaece5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:20.321466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf9976-0ac8-420b-9750-929b98eaece5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:20.321745 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf9976-0ac8-420b-9750-929b98eaece5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:20.364596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG passlib.handlers.bcrypt [None req-92cf9976-0ac8-420b-9750-929b98eaece5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81348) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 21 21:07:20.364990 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG passlib.handlers.bcrypt [None req-92cf9976-0ac8-420b-9750-929b98eaece5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81348) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 21 21:07:20.373096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:20.413698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-92cf9976-0ac8-420b-9750-929b98eaece5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:20.415313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-92cf9976-0ac8-420b-9750-929b98eaece5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:20.516119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:07:20.639665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bc29b-7626-4f46-8bf1-2ff40b6e8d96 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:20.665690 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:20.746627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bc29b-7626-4f46-8bf1-2ff40b6e8d96 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:20.780018 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab40c5-6f53-4c86-9af8-01f454f3de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:20.780656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab40c5-6f53-4c86-9af8-01f454f3de84 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:20.780942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab40c5-6f53-4c86-9af8-01f454f3de84 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:20.781225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab40c5-6f53-4c86-9af8-01f454f3de84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:20.786988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf9976-0ac8-420b-9750-929b98eaece5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:20.792887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab40c5-6f53-4c86-9af8-01f454f3de84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-8cab40c5-6f53-4c86-9af8-01f454f3de84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:20.802685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:20.804085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:20.805273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:20.812477 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab40c5-6f53-4c86-9af8-01f454f3de84 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:20.888082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf9976-0ac8-420b-9750-929b98eaece5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:20.890431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:20.893442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:20.913838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab40c5-6f53-4c86-9af8-01f454f3de84 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:20.925010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8294e2-7e7b-45c2-a641-4952d260f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:20.926176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8294e2-7e7b-45c2-a641-4952d260f307 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:20.926523 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8294e2-7e7b-45c2-a641-4952d260f307 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:20.926807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8294e2-7e7b-45c2-a641-4952d260f307 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:20.927824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8294e2-7e7b-45c2-a641-4952d260f307 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:20.929255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8294e2-7e7b-45c2-a641-4952d260f307 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:20.940158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.sql.core [None req-8c8294e2-7e7b-45c2-a641-4952d260f307 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 21 21:07:20.940158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 21 21:07:20.940158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [parameters: {'id': 'ae26160c50ec4093888c5a0062f4c281', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 21 21:07:20.940158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81348) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 21 21:07:20.946965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4250d3e-54b7-4c7d-950d-78da7cf51971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:20.947848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4250d3e-54b7-4c7d-950d-78da7cf51971 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:20.948129 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4250d3e-54b7-4c7d-950d-78da7cf51971 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:20.948404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4250d3e-54b7-4c7d-950d-78da7cf51971 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:20.949062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4250d3e-54b7-4c7d-950d-78da7cf51971 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:20.949361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4250d3e-54b7-4c7d-950d-78da7cf51971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:20.950727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4250d3e-54b7-4c7d-950d-78da7cf51971 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-8c8294e2-7e7b-45c2-a641-4952d260f307 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 21 21:07:20.959464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 21 21:07:20.960270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application yield resource Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.rollback() Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.force_reraise() Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise self.value Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application session.commit() Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 21 21:07:20.961163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._prepare_impl() Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.flush() Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._flush(objects) Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application compat.raise_( Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application flush_context.execute() Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rec.execute(self) Oct 21 21:07:20.962037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 21 21:07:20.962907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 21 21:07:20.963713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [parameters: {'id': 'ae26160c50ec4093888c5a0062f4c281', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 21 21:07:20.966211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:20.967625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:20.968909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 8/15] 10.222.0.23 () {60 vars in 1137 bytes} [Fri Oct 21 21:07:20 2022] POST /identity/v3/domains => generated 190 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:07:20.969909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:20.969993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8294e2-7e7b-45c2-a641-4952d260f307 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:20.970081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4250d3e-54b7-4c7d-950d-78da7cf51971 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:21.069299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4250d3e-54b7-4c7d-950d-78da7cf51971 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:21.073466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8294e2-7e7b-45c2-a641-4952d260f307 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:21.103595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5555-eca6-443a-94ff-288bbb6bcc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:21.104238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5555-eca6-443a-94ff-288bbb6bcc39 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:21.104527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5555-eca6-443a-94ff-288bbb6bcc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:21.104806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5555-eca6-443a-94ff-288bbb6bcc39 None admin] PATH_INFO: `/v3/users/03d71d1dd5394b76991f4fa1705c829c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:21.105967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a5555-eca6-443a-94ff-288bbb6bcc39 None admin] RBAC: Authorizing `identity:get_user(user_id=03d71d1dd5394b76991f4fa1705c829c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:21.107223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1746a7-dccf-413c-9792-b363bc03ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:21.107509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a5555-eca6-443a-94ff-288bbb6bcc39 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:21.108087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1746a7-dccf-413c-9792-b363bc03ebaf None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:21.108370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1746a7-dccf-413c-9792-b363bc03ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:21.108645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1746a7-dccf-413c-9792-b363bc03ebaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:21.109147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:20 2022] GET /identity/v3/users/03d71d1dd5394b76991f4fa1705c829c => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:21.114965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5555-eca6-443a-94ff-288bbb6bcc39 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:21.127497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1746a7-dccf-413c-9792-b363bc03ebaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:21.128983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:21.129079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1746a7-dccf-413c-9792-b363bc03ebaf None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-8f1746a7-dccf-413c-9792-b363bc03ebaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:07:21.145083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:21.146018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:07:21.146840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:07:21.146840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:07:21.146840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:21.146840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:07:21.152055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1746a7-dccf-413c-9792-b363bc03ebaf None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:21.173303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:21.221079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5555-eca6-443a-94ff-288bbb6bcc39 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:21.254526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1746a7-dccf-413c-9792-b363bc03ebaf None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:21.254910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61195d-b454-4a47-a234-fd9df3ad817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:21.255575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61195d-b454-4a47-a234-fd9df3ad817f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:21.255861 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61195d-b454-4a47-a234-fd9df3ad817f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:21.256144 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61195d-b454-4a47-a234-fd9df3ad817f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:21.257257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61195d-b454-4a47-a234-fd9df3ad817f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:21.258702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61195d-b454-4a47-a234-fd9df3ad817f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:21.260283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:21.266071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61195d-b454-4a47-a234-fd9df3ad817f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:21.292029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e7ada-f567-4243-ae82-59d66af812a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:21.292641 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e7ada-f567-4243-ae82-59d66af812a2 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:21.292919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e7ada-f567-4243-ae82-59d66af812a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:21.293191 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e7ada-f567-4243-ae82-59d66af812a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:21.293830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e7ada-f567-4243-ae82-59d66af812a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:21.294128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e7ada-f567-4243-ae82-59d66af812a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:21.295538 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e7ada-f567-4243-ae82-59d66af812a2 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:21.312516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:21.349948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:21.370296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61195d-b454-4a47-a234-fd9df3ad817f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:21.407441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f88263-b4eb-4b05-b162-0e7cd2e92ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:21.408034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f88263-b4eb-4b05-b162-0e7cd2e92ee5 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:21.408316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f88263-b4eb-4b05-b162-0e7cd2e92ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:21.408595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f88263-b4eb-4b05-b162-0e7cd2e92ee5 None admin] PATH_INFO: `/v3/domains/default/users/03d71d1dd5394b76991f4fa1705c829c/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:21.411101 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f88263-b4eb-4b05-b162-0e7cd2e92ee5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=03d71d1dd5394b76991f4fa1705c829c, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:21.412582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f88263-b4eb-4b05-b162-0e7cd2e92ee5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:21.526909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1361 bytes} [Fri Oct 21 21:07:21 2022] PUT /identity/v3/domains/default/users/03d71d1dd5394b76991f4fa1705c829c/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:07:23.996504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3acb7-325a-4ac9-9765-ab7d50a0923c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:23.997495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3acb7-325a-4ac9-9765-ab7d50a0923c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:23.997983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3acb7-325a-4ac9-9765-ab7d50a0923c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:23.999644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:24.005912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da4d37-6707-4b7d-8149-12088c9514c1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:24.006352 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da4d37-6707-4b7d-8149-12088c9514c1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:24.006526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da4d37-6707-4b7d-8149-12088c9514c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:24.036229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a4da4d37-6707-4b7d-8149-12088c9514c1 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:24.037768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a4da4d37-6707-4b7d-8149-12088c9514c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:24.064773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f70d6-4326-464c-9284-33e06ad8bb27 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:24.065325 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f70d6-4326-464c-9284-33e06ad8bb27 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:24.065863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f70d6-4326-464c-9284-33e06ad8bb27 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:24.068229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 12/23] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:24.073522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815dc8d-be5a-4633-af66-521002bfd576 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:24.074033 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815dc8d-be5a-4633-af66-521002bfd576 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:24.074508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815dc8d-be5a-4633-af66-521002bfd576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:24.105662 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7815dc8d-be5a-4633-af66-521002bfd576 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:24.107079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7815dc8d-be5a-4633-af66-521002bfd576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:24.153637 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:24.154999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2f4c0-94cd-49db-8e6d-6e81cfdd3ec8 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:24.155314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2f4c0-94cd-49db-8e6d-6e81cfdd3ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:24.155605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2f4c0-94cd-49db-8e6d-6e81cfdd3ec8 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:24.159760 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:24.168793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c245321-ada8-4c78-a13a-2a3659b0fa20 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:24.169084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c245321-ada8-4c78-a13a-2a3659b0fa20 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:24.169373 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c245321-ada8-4c78-a13a-2a3659b0fa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:24.183301 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:24.197717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1c245321-ada8-4c78-a13a-2a3659b0fa20 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:24.199176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1c245321-ada8-4c78-a13a-2a3659b0fa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:24.277809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:24.286151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:24.478911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fc1d4-33ff-42b1-afb9-5b103c106c2b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:24.479441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fc1d4-33ff-42b1-afb9-5b103c106c2b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:24.479853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fc1d4-33ff-42b1-afb9-5b103c106c2b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:24.481670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 14/28] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:24.486624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33e92-77d5-447d-a6b1-7372eaa65168 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:24.487135 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33e92-77d5-447d-a6b1-7372eaa65168 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:24.488332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33e92-77d5-447d-a6b1-7372eaa65168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:24.512157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a0d33e92-77d5-447d-a6b1-7372eaa65168 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:24.513676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a0d33e92-77d5-447d-a6b1-7372eaa65168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:24.536672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fc1d4-33ff-42b1-afb9-5b103c106c2b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:24.552517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:24.653556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:24.673841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fc1d4-33ff-42b1-afb9-5b103c106c2b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:24.688680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33e92-77d5-447d-a6b1-7372eaa65168 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:24.711657 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bcd1b-7eb8-4340-82e3-fabf535e7c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:24.712647 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bcd1b-7eb8-4340-82e3-fabf535e7c5a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:24.713173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bcd1b-7eb8-4340-82e3-fabf535e7c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:24.713644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bcd1b-7eb8-4340-82e3-fabf535e7c5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:24.725889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bcd1b-7eb8-4340-82e3-fabf535e7c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-1c0bcd1b-7eb8-4340-82e3-fabf535e7c5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:24.732793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:24.733664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:24.734443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:24.736541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:07:24.752020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bcd1b-7eb8-4340-82e3-fabf535e7c5a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:24.835501 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33e92-77d5-447d-a6b1-7372eaa65168 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:24.886850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:24.896130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:24.903225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8af65b-65a9-4567-a3f9-45c807598c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:24.903879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8af65b-65a9-4567-a3f9-45c807598c34 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:24.904170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8af65b-65a9-4567-a3f9-45c807598c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:24.904459 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8af65b-65a9-4567-a3f9-45c807598c34 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:24.905167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8af65b-65a9-4567-a3f9-45c807598c34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:24.906671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8af65b-65a9-4567-a3f9-45c807598c34 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:24.924337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 16/31] 10.222.0.23 () {60 vars in 1131 bytes} [Fri Oct 21 21:07:24 2022] POST /identity/v3/roles => generated 225 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:07:24.929008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8af65b-65a9-4567-a3f9-45c807598c34 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:24.959438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bcd1b-7eb8-4340-82e3-fabf535e7c5a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:25.025152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207bb4a-3617-4fd5-b6c2-7134d69d438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:25.025771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207bb4a-3617-4fd5-b6c2-7134d69d438a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.026041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207bb4a-3617-4fd5-b6c2-7134d69d438a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.026323 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207bb4a-3617-4fd5-b6c2-7134d69d438a None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.027006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207bb4a-3617-4fd5-b6c2-7134d69d438a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:25.027336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207bb4a-3617-4fd5-b6c2-7134d69d438a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:25.028783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207bb4a-3617-4fd5-b6c2-7134d69d438a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:25.047771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 16/32] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:25.048841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207bb4a-3617-4fd5-b6c2-7134d69d438a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:25.123286 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8af65b-65a9-4567-a3f9-45c807598c34 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:25.210565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207bb4a-3617-4fd5-b6c2-7134d69d438a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:25.211344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9f25c-9fb0-4713-82ba-ee9a2e66c50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:25.212011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9f25c-9fb0-4713-82ba-ee9a2e66c50e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.212297 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9f25c-9fb0-4713-82ba-ee9a2e66c50e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.212576 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9f25c-9fb0-4713-82ba-ee9a2e66c50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.226138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9f25c-9fb0-4713-82ba-ee9a2e66c50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:25.228066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9f25c-9fb0-4713-82ba-ee9a2e66c50e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-4ce9f25c-9fb0-4713-82ba-ee9a2e66c50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:07:25.246673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:25.247622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:07:25.248442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:07:25.248442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:07:25.248442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:25.249077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:25.250819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:25.251935 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9f25c-9fb0-4713-82ba-ee9a2e66c50e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:25.257023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d4350-22bf-41f4-9997-2e48d5151503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:25.258695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d4350-22bf-41f4-9997-2e48d5151503 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.258993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d4350-22bf-41f4-9997-2e48d5151503 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.259304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d4350-22bf-41f4-9997-2e48d5151503 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.259973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d4350-22bf-41f4-9997-2e48d5151503 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:25.261360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d4350-22bf-41f4-9997-2e48d5151503 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:25.303241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:25.373943 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9f25c-9fb0-4713-82ba-ee9a2e66c50e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:25.418629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22d665-9c0f-4120-86b1-c1a57e8be7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:25.419672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d665-9c0f-4120-86b1-c1a57e8be7db None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.420159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d665-9c0f-4120-86b1-c1a57e8be7db None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.420679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d665-9c0f-4120-86b1-c1a57e8be7db None admin] PATH_INFO: `/v3/users/03d71d1dd5394b76991f4fa1705c829c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.421571 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 17/34] 10.222.0.23 () {60 vars in 1131 bytes} [Fri Oct 21 21:07:25 2022] POST /identity/v3/roles => generated 219 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:25.422334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22d665-9c0f-4120-86b1-c1a57e8be7db None admin] RBAC: Authorizing `identity:get_user(user_id=03d71d1dd5394b76991f4fa1705c829c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:25.422682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d4350-22bf-41f4-9997-2e48d5151503 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:25.424343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22d665-9c0f-4120-86b1-c1a57e8be7db None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:25.426369 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 18/35] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:25 2022] GET /identity/v3/users/03d71d1dd5394b76991f4fa1705c829c => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:25.434004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22d665-9c0f-4120-86b1-c1a57e8be7db None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:25.638896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22d665-9c0f-4120-86b1-c1a57e8be7db None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:25.649084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d4350-22bf-41f4-9997-2e48d5151503 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:25.653125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:25.689071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b970f5-3734-4109-b0ef-085ab5f9ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:25.690029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b970f5-3734-4109-b0ef-085ab5f9ba66 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.690029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b970f5-3734-4109-b0ef-085ab5f9ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.690271 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b970f5-3734-4109-b0ef-085ab5f9ba66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.692482 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b970f5-3734-4109-b0ef-085ab5f9ba66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:25.694293 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b970f5-3734-4109-b0ef-085ab5f9ba66 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:25.696457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 19/36] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:25.697013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9ad13-9cd6-4782-bb5b-67544aa7ca40 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.697466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9ad13-9cd6-4782-bb5b-67544aa7ca40 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.698672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9ad13-9cd6-4782-bb5b-67544aa7ca40 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.698995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 20/37] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:25.701364 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9ad13-9cd6-4782-bb5b-67544aa7ca40 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:25.708880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f90a69-c5b1-4002-b055-cfcc87f8568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:25.709883 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f90a69-c5b1-4002-b055-cfcc87f8568a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.710387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f90a69-c5b1-4002-b055-cfcc87f8568a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.710864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f90a69-c5b1-4002-b055-cfcc87f8568a None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.711885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f90a69-c5b1-4002-b055-cfcc87f8568a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:25.712394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f90a69-c5b1-4002-b055-cfcc87f8568a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:25.714294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f90a69-c5b1-4002-b055-cfcc87f8568a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:25.729342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 18/38] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:25.731078 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bc182-04e7-4512-b566-e39af98c8749 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.731603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bc182-04e7-4512-b566-e39af98c8749 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.732086 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bc182-04e7-4512-b566-e39af98c8749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.753615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-bc5bc182-04e7-4512-b566-e39af98c8749 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:25.755490 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bc5bc182-04e7-4512-b566-e39af98c8749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:25.804298 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:25.816789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9ad13-9cd6-4782-bb5b-67544aa7ca40 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:25.824806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 19/39] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:25.832300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bc182-04e7-4512-b566-e39af98c8749 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:25.861932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f97292-eaab-4936-9789-4af01e574ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:25.862894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f97292-eaab-4936-9789-4af01e574ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.863347 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f97292-eaab-4936-9789-4af01e574ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.863765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f97292-eaab-4936-9789-4af01e574ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.864628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f97292-eaab-4936-9789-4af01e574ff8 None admin] RBAC: Adding query filter params (role.id=58b61e8083c64fd58b3eb63efc4c7e3e, scope.domain.id=default, user.id=03d71d1dd5394b76991f4fa1705c829c) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:25.865107 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f97292-eaab-4936-9789-4af01e574ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:25.866554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f97292-eaab-4936-9789-4af01e574ff8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:25.873755 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 21/40] 10.222.0.23 () {56 vars in 1322 bytes} [Fri Oct 21 21:07:25 2022] GET /identity/v3/role_assignments?user.id=03d71d1dd5394b76991f4fa1705c829c&scope.domain.id=default&role.id=58b61e8083c64fd58b3eb63efc4c7e3e => generated 530 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:25.874857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf006ba-d0fd-42d5-9b67-8808d50c0396 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.875153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf006ba-d0fd-42d5-9b67-8808d50c0396 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.875469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf006ba-d0fd-42d5-9b67-8808d50c0396 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.876830 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 22/41] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:25.883205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec35c90-14be-4169-87bc-a79487ddbaa2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:25.883557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec35c90-14be-4169-87bc-a79487ddbaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:25.883832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec35c90-14be-4169-87bc-a79487ddbaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:25.961175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bc182-04e7-4512-b566-e39af98c8749 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:26.006094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e6f89-b2f9-4247-9396-97fb632b7f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:26.007120 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6f89-b2f9-4247-9396-97fb632b7f5b None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:26.007662 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6f89-b2f9-4247-9396-97fb632b7f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:26.008136 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6f89-b2f9-4247-9396-97fb632b7f5b None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:26.009079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e6f89-b2f9-4247-9396-97fb632b7f5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:26.010854 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e6f89-b2f9-4247-9396-97fb632b7f5b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:26.037035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-cec35c90-14be-4169-87bc-a79487ddbaa2 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:26.038291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cec35c90-14be-4169-87bc-a79487ddbaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:26.046914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 20/42] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:07:25 2022] POST /identity/v3/projects => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:26.093973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:26.096433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e6f89-b2f9-4247-9396-97fb632b7f5b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:26.138382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 23/43] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:07:26.148871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:26.230223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e6f89-b2f9-4247-9396-97fb632b7f5b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:26.265217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdcc01-e026-41db-abce-280a3781c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:26.265841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdcc01-e026-41db-abce-280a3781c9be None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:26.266128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdcc01-e026-41db-abce-280a3781c9be None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:26.266412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdcc01-e026-41db-abce-280a3781c9be None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:26.267087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdcc01-e026-41db-abce-280a3781c9be None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:26.268521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdcc01-e026-41db-abce-280a3781c9be None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:26.284493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 21/44] 10.222.0.23 () {60 vars in 1131 bytes} [Fri Oct 21 21:07:26 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:26.415595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec35c90-14be-4169-87bc-a79487ddbaa2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:26.515543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec35c90-14be-4169-87bc-a79487ddbaa2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:26.548813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1af41-0abe-4240-9d78-9099156730df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:26.549444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1af41-0abe-4240-9d78-9099156730df None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:26.549728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1af41-0abe-4240-9d78-9099156730df None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:26.550004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1af41-0abe-4240-9d78-9099156730df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:26.551369 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1af41-0abe-4240-9d78-9099156730df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:26.552813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1af41-0abe-4240-9d78-9099156730df None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:26.554402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 24/45] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:26.560121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdcc01-e026-41db-abce-280a3781c9be None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:26.652895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:26.660430 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdcc01-e026-41db-abce-280a3781c9be None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:26.693986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defde5ef-d302-445f-bebd-253b69f057d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:26.694588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defde5ef-d302-445f-bebd-253b69f057d8 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:26.694873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defde5ef-d302-445f-bebd-253b69f057d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:26.695155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defde5ef-d302-445f-bebd-253b69f057d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:26.695846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defde5ef-d302-445f-bebd-253b69f057d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:26.697513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defde5ef-d302-445f-bebd-253b69f057d8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:26.722659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 22/46] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:07:26 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:28.838939 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c679cc2-12f4-409f-a9a3-fb2bd9181096 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:28.839498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c679cc2-12f4-409f-a9a3-fb2bd9181096 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:28.839580 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c679cc2-12f4-409f-a9a3-fb2bd9181096 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:28.840890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 25/47] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:28.845979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ca2c0-eef6-4785-b6c7-934e1934ae04 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:28.846339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ca2c0-eef6-4785-b6c7-934e1934ae04 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:28.846546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ca2c0-eef6-4785-b6c7-934e1934ae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:28.865564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f01ca2c0-eef6-4785-b6c7-934e1934ae04 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:28.866741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f01ca2c0-eef6-4785-b6c7-934e1934ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:28.931658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 23/48] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:29.201558 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c679cc2-12f4-409f-a9a3-fb2bd9181096 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:29.244610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:29.301727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c679cc2-12f4-409f-a9a3-fb2bd9181096 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:29.334651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61226693-639c-4c05-9af6-d8e6d63f10e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:29.335300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61226693-639c-4c05-9af6-d8e6d63f10e5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:29.335580 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61226693-639c-4c05-9af6-d8e6d63f10e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:29.335859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61226693-639c-4c05-9af6-d8e6d63f10e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:29.336966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61226693-639c-4c05-9af6-d8e6d63f10e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:29.338394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61226693-639c-4c05-9af6-d8e6d63f10e5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:29.339970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 26/49] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:29.345403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ca2c0-eef6-4785-b6c7-934e1934ae04 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:29.419446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:29.442432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ca2c0-eef6-4785-b6c7-934e1934ae04 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:29.475627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da904d21-80f7-47b9-ae20-fef090186840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:29.476173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da904d21-80f7-47b9-ae20-fef090186840 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:29.476455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da904d21-80f7-47b9-ae20-fef090186840 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:29.476732 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da904d21-80f7-47b9-ae20-fef090186840 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:29.477385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da904d21-80f7-47b9-ae20-fef090186840 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:29.478822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da904d21-80f7-47b9-ae20-fef090186840 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:29.502978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 24/50] 10.222.0.23 () {60 vars in 1140 bytes} [Fri Oct 21 21:07:29 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:31.628273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b11a1-d5a3-4eb4-a1f2-9f20ab020281 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:31.628787 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b11a1-d5a3-4eb4-a1f2-9f20ab020281 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:31.628871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b11a1-d5a3-4eb4-a1f2-9f20ab020281 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:31.630184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 27/51] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:31.635714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea906e-6a2b-49f1-bad0-6bdd0f96f8e8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:31.636110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea906e-6a2b-49f1-bad0-6bdd0f96f8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:31.636291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea906e-6a2b-49f1-bad0-6bdd0f96f8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:31.654498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9cea906e-6a2b-49f1-bad0-6bdd0f96f8e8 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:31.655728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9cea906e-6a2b-49f1-bad0-6bdd0f96f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:31.719228 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 25/52] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:31.983529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b11a1-d5a3-4eb4-a1f2-9f20ab020281 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:32.082957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b11a1-d5a3-4eb4-a1f2-9f20ab020281 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:32.091920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:32.116305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db039d-9d7b-488c-a724-d022f84a6eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:32.116925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db039d-9d7b-488c-a724-d022f84a6eef None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:32.117207 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db039d-9d7b-488c-a724-d022f84a6eef None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:32.117483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db039d-9d7b-488c-a724-d022f84a6eef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:32.118576 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db039d-9d7b-488c-a724-d022f84a6eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:32.120030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db039d-9d7b-488c-a724-d022f84a6eef None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:32.121633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 28/53] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:32.127310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea906e-6a2b-49f1-bad0-6bdd0f96f8e8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:32.182781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:32.223675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea906e-6a2b-49f1-bad0-6bdd0f96f8e8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:32.256461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fe730-ebb0-4cd6-aae2-de2f31bc36da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:32.257001 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe730-ebb0-4cd6-aae2-de2f31bc36da None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:32.257283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe730-ebb0-4cd6-aae2-de2f31bc36da None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:32.257555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe730-ebb0-4cd6-aae2-de2f31bc36da None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:32.258206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fe730-ebb0-4cd6-aae2-de2f31bc36da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:32.259662 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fe730-ebb0-4cd6-aae2-de2f31bc36da None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:32.388772 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 26/54] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:07:32 2022] POST /identity/v3/users => generated 275 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:35.401381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de7f8-4b36-4ff3-9f22-390b4986a98d None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:35.402226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de7f8-4b36-4ff3-9f22-390b4986a98d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:35.402643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de7f8-4b36-4ff3-9f22-390b4986a98d None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:35.404455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 29/55] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:35.409632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfe936-fb6b-49f6-887b-09974f4aa7fb None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:35.410361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfe936-fb6b-49f6-887b-09974f4aa7fb None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:35.410805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfe936-fb6b-49f6-887b-09974f4aa7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:35.431586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4cdfe936-fb6b-49f6-887b-09974f4aa7fb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:35.432979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4cdfe936-fb6b-49f6-887b-09974f4aa7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:35.525838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 27/56] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:35.907165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a6599-1b3a-41a7-8beb-2347f86e77d4 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:35.907165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a6599-1b3a-41a7-8beb-2347f86e77d4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:35.907165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a6599-1b3a-41a7-8beb-2347f86e77d4 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:35.907165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 30/57] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:35.912834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587edf12-cdc5-468a-8c1d-50677623ed02 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:35.913346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587edf12-cdc5-468a-8c1d-50677623ed02 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:35.913841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587edf12-cdc5-468a-8c1d-50677623ed02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:35.932268 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-587edf12-cdc5-468a-8c1d-50677623ed02 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:35.933730 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-587edf12-cdc5-468a-8c1d-50677623ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:35.939114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a6599-1b3a-41a7-8beb-2347f86e77d4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:36.009097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:36.040092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 28/58] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:36.047312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f2d65-2038-42c3-ad01-94030bd64ad2 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.048274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f2d65-2038-42c3-ad01-94030bd64ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.048759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f2d65-2038-42c3-ad01-94030bd64ad2 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.050989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 29/59] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:36.057712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f857-241b-4ba4-bce5-3380c1c8887a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.058384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f857-241b-4ba4-bce5-3380c1c8887a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.058861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f857-241b-4ba4-bce5-3380c1c8887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.097631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-35b6f857-241b-4ba4-bce5-3380c1c8887a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:36.098850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-35b6f857-241b-4ba4-bce5-3380c1c8887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:36.116948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a6599-1b3a-41a7-8beb-2347f86e77d4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:36.192174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da333ac-08ef-4a84-bf0d-d00277fe9809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:36.193114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da333ac-08ef-4a84-bf0d-d00277fe9809 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.193605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da333ac-08ef-4a84-bf0d-d00277fe9809 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.194079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da333ac-08ef-4a84-bf0d-d00277fe9809 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.205916 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da333ac-08ef-4a84-bf0d-d00277fe9809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:36.210286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 30/60] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:07:36.211722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4819-5888-42fd-ad45-83f68d375612 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.212089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4819-5888-42fd-ad45-83f68d375612 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.212440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf4819-5888-42fd-ad45-83f68d375612 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-2da333ac-08ef-4a84-bf0d-d00277fe9809 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:36.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:36.213572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:36.214320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:36.214882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 31/61] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:36.220316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 31/62] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:36.220500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b993a-b46c-48ae-9b54-bcbb353eae6c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.223295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b993a-b46c-48ae-9b54-bcbb353eae6c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.223295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b993a-b46c-48ae-9b54-bcbb353eae6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.227222 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da333ac-08ef-4a84-bf0d-d00277fe9809 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:36.240940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-934b993a-b46c-48ae-9b54-bcbb353eae6c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:36.242216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-934b993a-b46c-48ae-9b54-bcbb353eae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:36.263700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:36.313646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:07:36.314905 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0570a1-416b-4fa4-9fbe-5d66a74efc25 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.315198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0570a1-416b-4fa4-9fbe-5d66a74efc25 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.315515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0570a1-416b-4fa4-9fbe-5d66a74efc25 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.316950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 33/64] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:36.321929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161e306-20c5-4cf5-ada8-b2008846dd38 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.322220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161e306-20c5-4cf5-ada8-b2008846dd38 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.322759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161e306-20c5-4cf5-ada8-b2008846dd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.339019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da333ac-08ef-4a84-bf0d-d00277fe9809 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:36.356392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5161e306-20c5-4cf5-ada8-b2008846dd38 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:36.357707 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5161e306-20c5-4cf5-ada8-b2008846dd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:36.375766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9848562-fafb-47b0-9cae-0b7d26509859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:36.376622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848562-fafb-47b0-9cae-0b7d26509859 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.377094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848562-fafb-47b0-9cae-0b7d26509859 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.377928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848562-fafb-47b0-9cae-0b7d26509859 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.379678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9848562-fafb-47b0-9cae-0b7d26509859 None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:36.380191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9848562-fafb-47b0-9cae-0b7d26509859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:36.381916 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9848562-fafb-47b0-9cae-0b7d26509859 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:36.391605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 32/65] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:36.408565 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9848562-fafb-47b0-9cae-0b7d26509859 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:36.413782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:36.460171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 34/66] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:07:36.467415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161e306-20c5-4cf5-ada8-b2008846dd38 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:36.548452 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:36.554522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9848562-fafb-47b0-9cae-0b7d26509859 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:36.561868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161e306-20c5-4cf5-ada8-b2008846dd38 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:36.590961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35d64-5968-499b-a031-2e0e9cac61f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:36.592063 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35d64-5968-499b-a031-2e0e9cac61f2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.592545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35d64-5968-499b-a031-2e0e9cac61f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.593187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35d64-5968-499b-a031-2e0e9cac61f2 None admin] PATH_INFO: `/v3/users/78bf1c78c35546668f4dd2fc9ca541d6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.596784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24d9f0-f4bd-4ac9-ac41-e88befc42573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:36.597974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24d9f0-f4bd-4ac9-ac41-e88befc42573 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.598255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24d9f0-f4bd-4ac9-ac41-e88befc42573 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.598527 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24d9f0-f4bd-4ac9-ac41-e88befc42573 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.609188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24d9f0-f4bd-4ac9-ac41-e88befc42573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:36.610605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff35d64-5968-499b-a031-2e0e9cac61f2 None admin] RBAC: Authorizing `identity:get_user(user_id=78bf1c78c35546668f4dd2fc9ca541d6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:36.612284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff35d64-5968-499b-a031-2e0e9cac61f2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:36.614763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 33/67] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:36 2022] GET /identity/v3/users/78bf1c78c35546668f4dd2fc9ca541d6 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-4f24d9f0-f4bd-4ac9-ac41-e88befc42573 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:36.614866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:36.615689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:36.616441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 35/68] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:07:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:36.617053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24d9f0-f4bd-4ac9-ac41-e88befc42573 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:36.622961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35d64-5968-499b-a031-2e0e9cac61f2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:36.648188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:36.730868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24d9f0-f4bd-4ac9-ac41-e88befc42573 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:36.731023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff35d64-5968-499b-a031-2e0e9cac61f2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:36.765629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b23df-b33e-4f4e-8d5b-ef5c109e8c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:36.766267 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b23df-b33e-4f4e-8d5b-ef5c109e8c7a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.766556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b23df-b33e-4f4e-8d5b-ef5c109e8c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.766837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b23df-b33e-4f4e-8d5b-ef5c109e8c7a None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.767755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ba666-97ed-4cc7-89ff-54ec8f9708b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:36.768521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ba666-97ed-4cc7-89ff-54ec8f9708b8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.769489 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ba666-97ed-4cc7-89ff-54ec8f9708b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.769897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ba666-97ed-4cc7-89ff-54ec8f9708b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.770567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b23df-b33e-4f4e-8d5b-ef5c109e8c7a None admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:36.772036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b23df-b33e-4f4e-8d5b-ef5c109e8c7a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:36.773863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:36 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:36.774465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b23df-b33e-4f4e-8d5b-ef5c109e8c7a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:36.785412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ba666-97ed-4cc7-89ff-54ec8f9708b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-660ba666-97ed-4cc7-89ff-54ec8f9708b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:36.790249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:36.791109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:36.791906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:36.792543 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ba666-97ed-4cc7-89ff-54ec8f9708b8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:36.802528 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:36.874282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:36.876353 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b23df-b33e-4f4e-8d5b-ef5c109e8c7a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:36.890339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ba666-97ed-4cc7-89ff-54ec8f9708b8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:36.910782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be53e6-c006-47c0-8e01-1c6e0fa87a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:36.911444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be53e6-c006-47c0-8e01-1c6e0fa87a45 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.911727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be53e6-c006-47c0-8e01-1c6e0fa87a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.912012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be53e6-c006-47c0-8e01-1c6e0fa87a45 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.912680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be53e6-c006-47c0-8e01-1c6e0fa87a45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:36.912986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be53e6-c006-47c0-8e01-1c6e0fa87a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:36.914359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be53e6-c006-47c0-8e01-1c6e0fa87a45 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:36.922646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:07:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:36.923252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be53e6-c006-47c0-8e01-1c6e0fa87a45 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:36.931093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d3266-e09d-4e31-900e-d16c3057336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:36.931758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d3266-e09d-4e31-900e-d16c3057336e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:36.932042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d3266-e09d-4e31-900e-d16c3057336e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:36.932318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d3266-e09d-4e31-900e-d16c3057336e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:36.942347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d3266-e09d-4e31-900e-d16c3057336e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-f06d3266-e09d-4e31-900e-d16c3057336e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:36.947147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:36.948461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:36.949239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:36.949867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d3266-e09d-4e31-900e-d16c3057336e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.009261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:37.024064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be53e6-c006-47c0-8e01-1c6e0fa87a45 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.048501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d3266-e09d-4e31-900e-d16c3057336e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.059993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f0357-c9f6-4f25-984e-18a705b5b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.060666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0357-c9f6-4f25-984e-18a705b5b9aa None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.061016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0357-c9f6-4f25-984e-18a705b5b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.061344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0357-c9f6-4f25-984e-18a705b5b9aa None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/users/78bf1c78c35546668f4dd2fc9ca541d6/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.063348 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f0357-c9f6-4f25-984e-18a705b5b9aa None admin] RBAC: Authorizing `identity:create_grant(project_id=d246b911cdcc47c3831ebcc2ccfa85c4, user_id=78bf1c78c35546668f4dd2fc9ca541d6, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.064809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f0357-c9f6-4f25-984e-18a705b5b9aa None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.077605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 36/73] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:07:36 2022] PUT /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/users/78bf1c78c35546668f4dd2fc9ca541d6/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:07:37.078410 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f0357-c9f6-4f25-984e-18a705b5b9aa None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.099772 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b3dcf-02d2-43c5-b96a-62e53649e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.100501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3dcf-02d2-43c5-b96a-62e53649e641 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.100789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3dcf-02d2-43c5-b96a-62e53649e641 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.101084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3dcf-02d2-43c5-b96a-62e53649e641 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.102395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b3dcf-02d2-43c5-b96a-62e53649e641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.103955 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b3dcf-02d2-43c5-b96a-62e53649e641 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.105902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 38/74] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:37.106580 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b3dcf-02d2-43c5-b96a-62e53649e641 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.123441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:37.206467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f0357-c9f6-4f25-984e-18a705b5b9aa None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.229899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b3dcf-02d2-43c5-b96a-62e53649e641 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.243512 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5f39-f116-4ae5-8734-6e4a09a39a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.244176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5f39-f116-4ae5-8734-6e4a09a39a02 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.244423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5f39-f116-4ae5-8734-6e4a09a39a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.244706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5f39-f116-4ae5-8734-6e4a09a39a02 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.245377 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac5f39-f116-4ae5-8734-6e4a09a39a02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:37.245686 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac5f39-f116-4ae5-8734-6e4a09a39a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.247073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac5f39-f116-4ae5-8734-6e4a09a39a02 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.257487 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:37.258153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5f39-f116-4ae5-8734-6e4a09a39a02 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.269917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:37.270964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7299b04-e7a6-4662-a356-b79706226ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.273597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7299b04-e7a6-4662-a356-b79706226ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.273597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7299b04-e7a6-4662-a356-b79706226ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.273597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7299b04-e7a6-4662-a356-b79706226ec5 None admin] PATH_INFO: `/v3/users/78bf1c78c35546668f4dd2fc9ca541d6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.273861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7299b04-e7a6-4662-a356-b79706226ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=78bf1c78c35546668f4dd2fc9ca541d6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.275258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7299b04-e7a6-4662-a356-b79706226ec5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.276888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 39/76] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:37 2022] GET /identity/v3/users/78bf1c78c35546668f4dd2fc9ca541d6 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:37.277639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7299b04-e7a6-4662-a356-b79706226ec5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.366016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5f39-f116-4ae5-8734-6e4a09a39a02 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.370342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:37.393301 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7299b04-e7a6-4662-a356-b79706226ec5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.402003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2feb3-3948-4684-ac16-988edde117b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.402625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2feb3-3948-4684-ac16-988edde117b7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.402910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2feb3-3948-4684-ac16-988edde117b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.403196 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2feb3-3948-4684-ac16-988edde117b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.403896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2feb3-3948-4684-ac16-988edde117b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:37.404208 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2feb3-3948-4684-ac16-988edde117b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.405610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2feb3-3948-4684-ac16-988edde117b7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.414775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 38/77] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:37.415607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2feb3-3948-4684-ac16-988edde117b7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.434719 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2da2a-3185-4673-b61e-bb13407e1710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.435901 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2da2a-3185-4673-b61e-bb13407e1710 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.436330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2da2a-3185-4673-b61e-bb13407e1710 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.436737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2da2a-3185-4673-b61e-bb13407e1710 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.437556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2da2a-3185-4673-b61e-bb13407e1710 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.439127 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2da2a-3185-4673-b61e-bb13407e1710 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.464190 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 40/78] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:07:37 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:37.465134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2da2a-3185-4673-b61e-bb13407e1710 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.495529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:37.530206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2feb3-3948-4684-ac16-988edde117b7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.574481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3eb88-b77c-4d92-8111-84f1e1e01750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.575708 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3eb88-b77c-4d92-8111-84f1e1e01750 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.576140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3eb88-b77c-4d92-8111-84f1e1e01750 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.576569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3eb88-b77c-4d92-8111-84f1e1e01750 None admin] PATH_INFO: `/v3/users/03d71d1dd5394b76991f4fa1705c829c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.578001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3eb88-b77c-4d92-8111-84f1e1e01750 None admin] RBAC: Authorizing `identity:get_user(user_id=03d71d1dd5394b76991f4fa1705c829c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.579733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3eb88-b77c-4d92-8111-84f1e1e01750 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.582635 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 39/79] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:37 2022] GET /identity/v3/users/03d71d1dd5394b76991f4fa1705c829c => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:37.583840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3eb88-b77c-4d92-8111-84f1e1e01750 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.613267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2da2a-3185-4673-b61e-bb13407e1710 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.663973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc59f4-8cc7-4a9e-8399-4494b42da53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.665034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc59f4-8cc7-4a9e-8399-4494b42da53d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.665524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc59f4-8cc7-4a9e-8399-4494b42da53d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.666044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc59f4-8cc7-4a9e-8399-4494b42da53d None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.667792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc59f4-8cc7-4a9e-8399-4494b42da53d None admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.669531 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc59f4-8cc7-4a9e-8399-4494b42da53d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.678631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:37 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:37.678631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc59f4-8cc7-4a9e-8399-4494b42da53d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.680545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:37.707017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3eb88-b77c-4d92-8111-84f1e1e01750 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.758639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3692a1-0df9-4c5d-bcbd-02678ad22a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.761896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3692a1-0df9-4c5d-bcbd-02678ad22a59 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.761896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3692a1-0df9-4c5d-bcbd-02678ad22a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.761896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3692a1-0df9-4c5d-bcbd-02678ad22a59 None admin] PATH_INFO: `/v3/users/78bf1c78c35546668f4dd2fc9ca541d6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.763099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3692a1-0df9-4c5d-bcbd-02678ad22a59 None admin] RBAC: Authorizing `identity:get_user(user_id=78bf1c78c35546668f4dd2fc9ca541d6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.764964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3692a1-0df9-4c5d-bcbd-02678ad22a59 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.767079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 40/81] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:37 2022] GET /identity/v3/users/78bf1c78c35546668f4dd2fc9ca541d6 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:37.767736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3692a1-0df9-4c5d-bcbd-02678ad22a59 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.780572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:37.810950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc59f4-8cc7-4a9e-8399-4494b42da53d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.861717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be88b91-8eca-452f-a28a-33d8fcd9223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.862633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be88b91-8eca-452f-a28a-33d8fcd9223d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.863019 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be88b91-8eca-452f-a28a-33d8fcd9223d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.863431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be88b91-8eca-452f-a28a-33d8fcd9223d None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.865755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be88b91-8eca-452f-a28a-33d8fcd9223d None admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.867370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be88b91-8eca-452f-a28a-33d8fcd9223d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.869260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 42/82] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:37 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:37.870176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be88b91-8eca-452f-a28a-33d8fcd9223d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:37.908390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3692a1-0df9-4c5d-bcbd-02678ad22a59 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:37.952068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93505527-dd0b-4888-b558-1206ca5ade20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:37.952749 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93505527-dd0b-4888-b558-1206ca5ade20 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:37.953040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93505527-dd0b-4888-b558-1206ca5ade20 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:37.953324 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93505527-dd0b-4888-b558-1206ca5ade20 None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/users/78bf1c78c35546668f4dd2fc9ca541d6/roles/d742ebaf9dcb49d38c4758375c5ebd1f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:37.957009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93505527-dd0b-4888-b558-1206ca5ade20 None admin] RBAC: Authorizing `identity:create_grant(project_id=d246b911cdcc47c3831ebcc2ccfa85c4, user_id=78bf1c78c35546668f4dd2fc9ca541d6, role_id=d742ebaf9dcb49d38c4758375c5ebd1f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:37.958474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93505527-dd0b-4888-b558-1206ca5ade20 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:37.965107 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:37.978607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 41/83] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:07:37 2022] PUT /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/users/78bf1c78c35546668f4dd2fc9ca541d6/roles/d742ebaf9dcb49d38c4758375c5ebd1f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:07:37.979873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93505527-dd0b-4888-b558-1206ca5ade20 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:38.004990 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be88b91-8eca-452f-a28a-33d8fcd9223d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:38.047111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9153fa1-22df-4270-8506-e702a4fdc3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:38.047913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9153fa1-22df-4270-8506-e702a4fdc3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:38.048407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9153fa1-22df-4270-8506-e702a4fdc3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:38.048972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9153fa1-22df-4270-8506-e702a4fdc3f6 None admin] PATH_INFO: `/v3/projects/a6eea7e7abc1497a9e22891efa4129c7` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:38.056119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9153fa1-22df-4270-8506-e702a4fdc3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=a6eea7e7abc1497a9e22891efa4129c7)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:38.057920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9153fa1-22df-4270-8506-e702a4fdc3f6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:38.060108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 43/84] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:37 2022] GET /identity/v3/projects/a6eea7e7abc1497a9e22891efa4129c7 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:38.061950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:38.073586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9153fa1-22df-4270-8506-e702a4fdc3f6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:38.121799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93505527-dd0b-4888-b558-1206ca5ade20 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:38.172163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0d63d-09a4-4865-9977-379d82510c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:38.173116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d63d-09a4-4865-9977-379d82510c0e None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:38.173639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d63d-09a4-4865-9977-379d82510c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:38.174086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d63d-09a4-4865-9977-379d82510c0e None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/users/03d71d1dd5394b76991f4fa1705c829c/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:38.176937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0d63d-09a4-4865-9977-379d82510c0e None admin] RBAC: Authorizing `identity:create_grant(project_id=d246b911cdcc47c3831ebcc2ccfa85c4, user_id=03d71d1dd5394b76991f4fa1705c829c, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:38.178792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0d63d-09a4-4865-9977-379d82510c0e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:38.210773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:07:37 2022] PUT /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/users/03d71d1dd5394b76991f4fa1705c829c/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:07:38.216543 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9153fa1-22df-4270-8506-e702a4fdc3f6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:38.259734 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f468730-176f-441a-ae1a-d5367afe038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:38.260432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f468730-176f-441a-ae1a-d5367afe038d None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:38.260717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f468730-176f-441a-ae1a-d5367afe038d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:38.261009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f468730-176f-441a-ae1a-d5367afe038d None admin] PATH_INFO: `/v3/projects/a6eea7e7abc1497a9e22891efa4129c7/users/78bf1c78c35546668f4dd2fc9ca541d6/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:38.268181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f468730-176f-441a-ae1a-d5367afe038d None admin] RBAC: Authorizing `identity:create_grant(project_id=a6eea7e7abc1497a9e22891efa4129c7, user_id=78bf1c78c35546668f4dd2fc9ca541d6, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:38.270216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f468730-176f-441a-ae1a-d5367afe038d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:38.286326 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:38.292975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 44/86] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:07:38 2022] PUT /identity/v3/projects/a6eea7e7abc1497a9e22891efa4129c7/users/78bf1c78c35546668f4dd2fc9ca541d6/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:07:40.010150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644701a-b2ae-4785-ac2b-7de78e8f4c73 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:40.010661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644701a-b2ae-4785-ac2b-7de78e8f4c73 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:40.010733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644701a-b2ae-4785-ac2b-7de78e8f4c73 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:40.012091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 43/87] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:40.017566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f7bbd-7f64-4572-b75f-557a46ad5bf9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:40.017948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f7bbd-7f64-4572-b75f-557a46ad5bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:40.018123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f7bbd-7f64-4572-b75f-557a46ad5bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:40.048291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-124f7bbd-7f64-4572-b75f-557a46ad5bf9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:40.049512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-124f7bbd-7f64-4572-b75f-557a46ad5bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:40.122564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 45/88] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:40.471427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644701a-b2ae-4785-ac2b-7de78e8f4c73 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:40.572105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ef65-46e6-47a9-931a-bc44bd296b4e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:40.572418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ef65-46e6-47a9-931a-bc44bd296b4e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:40.573018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ef65-46e6-47a9-931a-bc44bd296b4e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:40.574704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 46/89] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:07:40.580134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f37a1-875e-4540-8e38-081daf82bbaa None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:40.580425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f37a1-875e-4540-8e38-081daf82bbaa None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:40.580708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f37a1-875e-4540-8e38-081daf82bbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:40.604998 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-606f37a1-875e-4540-8e38-081daf82bbaa None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:40.607345 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-606f37a1-875e-4540-8e38-081daf82bbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:40.613290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644701a-b2ae-4785-ac2b-7de78e8f4c73 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:40.665467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:40.687110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e87a3c-2cb8-4a41-a4f7-c81748453448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:40.688651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e87a3c-2cb8-4a41-a4f7-c81748453448 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:40.689611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e87a3c-2cb8-4a41-a4f7-c81748453448 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:40.690627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e87a3c-2cb8-4a41-a4f7-c81748453448 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:40.718243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e87a3c-2cb8-4a41-a4f7-c81748453448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-59e87a3c-2cb8-4a41-a4f7-c81748453448 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:40.724802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:40.725643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:40.726404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:40.738312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 44/90] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:40.744802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e87a3c-2cb8-4a41-a4f7-c81748453448 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:40.787322 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 47/91] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:40.906178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e87a3c-2cb8-4a41-a4f7-c81748453448 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:40.952683 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fec51a-16eb-4065-9283-532f92a5ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:40.953336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fec51a-16eb-4065-9283-532f92a5ed6f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:40.953623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fec51a-16eb-4065-9283-532f92a5ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:40.953906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fec51a-16eb-4065-9283-532f92a5ed6f None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:40.954581 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fec51a-16eb-4065-9283-532f92a5ed6f None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:40.954890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fec51a-16eb-4065-9283-532f92a5ed6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:40.956478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fec51a-16eb-4065-9283-532f92a5ed6f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:40.967063 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 45/92] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:40.972959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f37a1-875e-4540-8e38-081daf82bbaa None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:41.038242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c444966-1c71-467a-9dd7-6be4cc5dc47b None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:41.038242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c444966-1c71-467a-9dd7-6be4cc5dc47b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:41.038242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c444966-1c71-467a-9dd7-6be4cc5dc47b None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:41.039851 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 46/93] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:41.061188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c9e2-638a-4a51-8038-1febe0ce3aee None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:41.061188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c9e2-638a-4a51-8038-1febe0ce3aee None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:41.061559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c9e2-638a-4a51-8038-1febe0ce3aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:41.081159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:41.099950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6d48c9e2-638a-4a51-8038-1febe0ce3aee None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:41.101106 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6d48c9e2-638a-4a51-8038-1febe0ce3aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:41.135001 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f37a1-875e-4540-8e38-081daf82bbaa None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:41.187041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bda46-3d8e-4b05-a53f-904cf2a730cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:41.188082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bda46-3d8e-4b05-a53f-904cf2a730cf None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:41.188567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bda46-3d8e-4b05-a53f-904cf2a730cf None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:41.189046 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bda46-3d8e-4b05-a53f-904cf2a730cf None admin] PATH_INFO: `/v3/users/78bf1c78c35546668f4dd2fc9ca541d6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:41.190388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bda46-3d8e-4b05-a53f-904cf2a730cf None admin] RBAC: Authorizing `identity:get_user(user_id=78bf1c78c35546668f4dd2fc9ca541d6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:41.192135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bda46-3d8e-4b05-a53f-904cf2a730cf None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:41.198857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 48/94] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:40 2022] GET /identity/v3/users/78bf1c78c35546668f4dd2fc9ca541d6 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:41.200304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bda46-3d8e-4b05-a53f-904cf2a730cf None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:41.212179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:41.256959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 47/95] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:41.257761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48c9e2-638a-4a51-8038-1febe0ce3aee None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:41.312219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bda46-3d8e-4b05-a53f-904cf2a730cf None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:41.344398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:41.354308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531068d-9c67-48f5-8293-e463ab8b8840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:41.355198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531068d-9c67-48f5-8293-e463ab8b8840 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:41.355735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531068d-9c67-48f5-8293-e463ab8b8840 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:41.356212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531068d-9c67-48f5-8293-e463ab8b8840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:41.377533 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48c9e2-638a-4a51-8038-1febe0ce3aee None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:41.450320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d624c-8e84-4941-a6d5-3aae5250ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:41.450970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d624c-8e84-4941-a6d5-3aae5250ff87 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:41.451258 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d624c-8e84-4941-a6d5-3aae5250ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:41.451557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d624c-8e84-4941-a6d5-3aae5250ff87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:41.477981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d624c-8e84-4941-a6d5-3aae5250ff87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-4a0d624c-8e84-4941-a6d5-3aae5250ff87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:41.487604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:41.488539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:41.489301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 48/96] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:41.490796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ddd1-e75e-4d38-a2a7-e2afa911ad4e None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:41.494168 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531068d-9c67-48f5-8293-e463ab8b8840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:41.495722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531068d-9c67-48f5-8293-e463ab8b8840 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:41.499136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ddd1-e75e-4d38-a2a7-e2afa911ad4e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:41.499136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ddd1-e75e-4d38-a2a7-e2afa911ad4e None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:41.499136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 49/97] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:41.505621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9ca2c-74b6-43d7-b5da-ac3771ea4326 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:41.505909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9ca2c-74b6-43d7-b5da-ac3771ea4326 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:41.506183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9ca2c-74b6-43d7-b5da-ac3771ea4326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:41.546357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-67a9ca2c-74b6-43d7-b5da-ac3771ea4326 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:41.549783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-67a9ca2c-74b6-43d7-b5da-ac3771ea4326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:41.626597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:41.645006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 49/98] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 21 21:07:41.645006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531068d-9c67-48f5-8293-e463ab8b8840 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:41.672583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 50/99] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:41.673430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9ca2c-74b6-43d7-b5da-ac3771ea4326 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:41.686005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:41.771544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531068d-9c67-48f5-8293-e463ab8b8840 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:41.793907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9ca2c-74b6-43d7-b5da-ac3771ea4326 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:41.812854 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260689b4-ca78-4ea0-8d10-b675def3246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:41.813631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260689b4-ca78-4ea0-8d10-b675def3246d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:41.814072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260689b4-ca78-4ea0-8d10-b675def3246d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:41.814492 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260689b4-ca78-4ea0-8d10-b675def3246d None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:41.815346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260689b4-ca78-4ea0-8d10-b675def3246d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:41.816572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260689b4-ca78-4ea0-8d10-b675def3246d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:41.818492 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260689b4-ca78-4ea0-8d10-b675def3246d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:41.835031 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 50/100] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:41.836606 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ff9df-efb3-4e18-9b34-b03d2420b4db None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:41.837044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ff9df-efb3-4e18-9b34-b03d2420b4db None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:41.837462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ff9df-efb3-4e18-9b34-b03d2420b4db None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:41.837683 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f1cfc-a827-436a-a188-4146c8441149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:41.838497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f1cfc-a827-436a-a188-4146c8441149 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:41.838917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f1cfc-a827-436a-a188-4146c8441149 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:41.839369 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f1cfc-a827-436a-a188-4146c8441149 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:41.839614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 51/101] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:41.840357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ff9df-efb3-4e18-9b34-b03d2420b4db None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:41.841254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f1cfc-a827-436a-a188-4146c8441149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:41.842898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f1cfc-a827-436a-a188-4146c8441149 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:41.846071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 51/102] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:41.847182 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f1cfc-a827-436a-a188-4146c8441149 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:41.894677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:41.961817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:41.973481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f1cfc-a827-436a-a188-4146c8441149 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:41.982945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ff9df-efb3-4e18-9b34-b03d2420b4db None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:42.010212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6dbfe-4eef-4947-bf29-5cd4f1a736e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:42.010849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dbfe-4eef-4947-bf29-5cd4f1a736e1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.011130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dbfe-4eef-4947-bf29-5cd4f1a736e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.011440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6dbfe-4eef-4947-bf29-5cd4f1a736e1 None admin] PATH_INFO: `/v3/users/5af68c235be44f65957b83b9b1f06afd` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.018608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6e35-1674-472f-8958-c47a3d60fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:42.019295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6e35-1674-472f-8958-c47a3d60fe55 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.019579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6e35-1674-472f-8958-c47a3d60fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.019853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6e35-1674-472f-8958-c47a3d60fe55 None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.020964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6e35-1674-472f-8958-c47a3d60fe55 None admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:42.022404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6e35-1674-472f-8958-c47a3d60fe55 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:42.024202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 52/103] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:41 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:42.024367 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6dbfe-4eef-4947-bf29-5cd4f1a736e1 None admin] RBAC: Authorizing `identity:get_user(user_id=5af68c235be44f65957b83b9b1f06afd)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:42.025157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af205efb-8b14-492b-b2d8-c0d228ea75b6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.025439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af205efb-8b14-492b-b2d8-c0d228ea75b6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.025715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af205efb-8b14-492b-b2d8-c0d228ea75b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.025802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6dbfe-4eef-4947-bf29-5cd4f1a736e1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:42.031811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 52/104] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:41 2022] GET /identity/v3/users/5af68c235be44f65957b83b9b1f06afd => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:42.031811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6dbfe-4eef-4947-bf29-5cd4f1a736e1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:42.046838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-af205efb-8b14-492b-b2d8-c0d228ea75b6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:42.048092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-af205efb-8b14-492b-b2d8-c0d228ea75b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:42.114625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 53/105] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:42.115498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af205efb-8b14-492b-b2d8-c0d228ea75b6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:42.133955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:42.142191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6dbfe-4eef-4947-bf29-5cd4f1a736e1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:42.176730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3205a-2c3f-4dac-a8c4-58bf511dac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:42.177332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3205a-2c3f-4dac-a8c4-58bf511dac15 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.177615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3205a-2c3f-4dac-a8c4-58bf511dac15 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.177890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3205a-2c3f-4dac-a8c4-58bf511dac15 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.178537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3205a-2c3f-4dac-a8c4-58bf511dac15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:42.180018 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3205a-2c3f-4dac-a8c4-58bf511dac15 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:42.206493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:42.209403 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 53/106] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:07:42 2022] POST /identity/v3/projects => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:42.212591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96d9e5-6c20-40e3-865d-5ec8eba59ffd None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.212885 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96d9e5-6c20-40e3-865d-5ec8eba59ffd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.213168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96d9e5-6c20-40e3-865d-5ec8eba59ffd None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.214728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 54/107] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:42.216136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96d9e5-6c20-40e3-865d-5ec8eba59ffd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:42.232796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af205efb-8b14-492b-b2d8-c0d228ea75b6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:42.274941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986010-8b89-40bc-960b-d16a21556fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:42.275791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986010-8b89-40bc-960b-d16a21556fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.276024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986010-8b89-40bc-960b-d16a21556fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.276309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986010-8b89-40bc-960b-d16a21556fd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.290438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c986010-8b89-40bc-960b-d16a21556fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-1c986010-8b89-40bc-960b-d16a21556fd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:42.296838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:42.297766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:42.298530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 54/108] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:07:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:42.299150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986010-8b89-40bc-960b-d16a21556fd7 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:42.343741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96d9e5-6c20-40e3-865d-5ec8eba59ffd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:42.385856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04cbfc-7759-49ad-a5ba-c7e2ce88a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:42.386792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04cbfc-7759-49ad-a5ba-c7e2ce88a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.387084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04cbfc-7759-49ad-a5ba-c7e2ce88a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.387393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04cbfc-7759-49ad-a5ba-c7e2ce88a0f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.388171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04cbfc-7759-49ad-a5ba-c7e2ce88a0f0 None admin] RBAC: Adding query filter params (role.id=d446ff7289fd4718a77384fd80873ca4, scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4, user.id=78bf1c78c35546668f4dd2fc9ca541d6) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:42.388483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04cbfc-7759-49ad-a5ba-c7e2ce88a0f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:42.389990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04cbfc-7759-49ad-a5ba-c7e2ce88a0f0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:42.396641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 55/109] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:07:42 2022] GET /identity/v3/role_assignments?user.id=78bf1c78c35546668f4dd2fc9ca541d6&scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4&role.id=d446ff7289fd4718a77384fd80873ca4 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:42.397899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da2364-716d-46f1-a3b2-cbeb8ac6ba72 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.398185 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da2364-716d-46f1-a3b2-cbeb8ac6ba72 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.398459 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da2364-716d-46f1-a3b2-cbeb8ac6ba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.430435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d0da2364-716d-46f1-a3b2-cbeb8ac6ba72 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:42.431721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d0da2364-716d-46f1-a3b2-cbeb8ac6ba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:42.435994 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:42.437853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986010-8b89-40bc-960b-d16a21556fd7 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:42.484616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b9567-04e8-43d7-b009-aa641f90ff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:42.485277 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9567-04e8-43d7-b009-aa641f90ff6a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.485559 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9567-04e8-43d7-b009-aa641f90ff6a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.485841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9567-04e8-43d7-b009-aa641f90ff6a None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.487080 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b9567-04e8-43d7-b009-aa641f90ff6a None admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:42.489146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b9567-04e8-43d7-b009-aa641f90ff6a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:42.491074 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 55/110] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:42 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:42.491669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b9567-04e8-43d7-b009-aa641f90ff6a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:42.514706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:42.528366 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 56/111] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:42.528691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da2364-716d-46f1-a3b2-cbeb8ac6ba72 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:42.623972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b9567-04e8-43d7-b009-aa641f90ff6a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:42.667700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115565d-33b9-457d-bda4-f7a29a1e4c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:42.668328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115565d-33b9-457d-bda4-f7a29a1e4c65 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.668611 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115565d-33b9-457d-bda4-f7a29a1e4c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.668890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115565d-33b9-457d-bda4-f7a29a1e4c65 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.669569 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115565d-33b9-457d-bda4-f7a29a1e4c65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:42.669871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115565d-33b9-457d-bda4-f7a29a1e4c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:42.671262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115565d-33b9-457d-bda4-f7a29a1e4c65 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:42.680534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 56/112] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:07:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:42.681302 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115565d-33b9-457d-bda4-f7a29a1e4c65 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:42.686537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da2364-716d-46f1-a3b2-cbeb8ac6ba72 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:42.726659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceef1d-b3dd-48c9-847b-924d32e2c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:42.727327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceef1d-b3dd-48c9-847b-924d32e2c88c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.727669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceef1d-b3dd-48c9-847b-924d32e2c88c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.728046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceef1d-b3dd-48c9-847b-924d32e2c88c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.737605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:42.743849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cceef1d-b3dd-48c9-847b-924d32e2c88c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-8cceef1d-b3dd-48c9-847b-924d32e2c88c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:42.749569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:42.750433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:42.751220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:42.753439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 57/113] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:07:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:42.754833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceef1d-b3dd-48c9-847b-924d32e2c88c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:42.766175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:42.789715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115565d-33b9-457d-bda4-f7a29a1e4c65 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:42.830997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6734a-c8e8-4ab2-80c5-6905da90cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:42.832292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6734a-c8e8-4ab2-80c5-6905da90cf6a None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.832578 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6734a-c8e8-4ab2-80c5-6905da90cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.832858 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6734a-c8e8-4ab2-80c5-6905da90cf6a None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/users/5af68c235be44f65957b83b9b1f06afd/roles/a11998246b234a2a9156dcfbd29df373` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.834809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6734a-c8e8-4ab2-80c5-6905da90cf6a None admin] RBAC: Authorizing `identity:create_grant(project_id=d246b911cdcc47c3831ebcc2ccfa85c4, user_id=5af68c235be44f65957b83b9b1f06afd, role_id=a11998246b234a2a9156dcfbd29df373)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:42.836380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6734a-c8e8-4ab2-80c5-6905da90cf6a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:42.851761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 57/114] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:07:42 2022] PUT /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/users/5af68c235be44f65957b83b9b1f06afd/roles/a11998246b234a2a9156dcfbd29df373 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:07:42.852735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6734a-c8e8-4ab2-80c5-6905da90cf6a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:42.899683 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceef1d-b3dd-48c9-847b-924d32e2c88c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:42.948515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902bd2-634c-4dda-913b-c3836ba643bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:42.949318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902bd2-634c-4dda-913b-c3836ba643bf None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:42.949706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902bd2-634c-4dda-913b-c3836ba643bf None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:42.950121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902bd2-634c-4dda-913b-c3836ba643bf None admin] PATH_INFO: `/v3/users/78bf1c78c35546668f4dd2fc9ca541d6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:42.951569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97902bd2-634c-4dda-913b-c3836ba643bf None admin] RBAC: Authorizing `identity:get_user(user_id=78bf1c78c35546668f4dd2fc9ca541d6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:42.953932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97902bd2-634c-4dda-913b-c3836ba643bf None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:42.957096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 58/115] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:42 2022] GET /identity/v3/users/78bf1c78c35546668f4dd2fc9ca541d6 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:42.958664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902bd2-634c-4dda-913b-c3836ba643bf None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:42.983977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6734a-c8e8-4ab2-80c5-6905da90cf6a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:43.035524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39dfab-9635-4cc1-b033-d7ccd5d2186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:43.036161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39dfab-9635-4cc1-b033-d7ccd5d2186c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:43.036469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39dfab-9635-4cc1-b033-d7ccd5d2186c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:43.036742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39dfab-9635-4cc1-b033-d7ccd5d2186c None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:43.037426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39dfab-9635-4cc1-b033-d7ccd5d2186c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:43.037730 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39dfab-9635-4cc1-b033-d7ccd5d2186c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:43.039446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39dfab-9635-4cc1-b033-d7ccd5d2186c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:43.045563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:43.053091 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 58/116] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:43.055320 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39dfab-9635-4cc1-b033-d7ccd5d2186c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:43.059486 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:43.092532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902bd2-634c-4dda-913b-c3836ba643bf None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:43.130906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b10c37-cbc5-45d0-bffd-8524a13bf76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:43.131728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b10c37-cbc5-45d0-bffd-8524a13bf76e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:43.132160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b10c37-cbc5-45d0-bffd-8524a13bf76e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:43.132540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b10c37-cbc5-45d0-bffd-8524a13bf76e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:43.144203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b10c37-cbc5-45d0-bffd-8524a13bf76e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-a5b10c37-cbc5-45d0-bffd-8524a13bf76e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:43.149505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:43.150368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:43.151349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 59/117] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:43.152742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b10c37-cbc5-45d0-bffd-8524a13bf76e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:43.180120 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39dfab-9635-4cc1-b033-d7ccd5d2186c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:43.221025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b0b8c-1e07-4193-bd99-45174238fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:43.222447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b0b8c-1e07-4193-bd99-45174238fde0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:43.223166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b0b8c-1e07-4193-bd99-45174238fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:43.224040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b0b8c-1e07-4193-bd99-45174238fde0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:43.267548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b10c37-cbc5-45d0-bffd-8524a13bf76e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:43.301880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:43.303033 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:43.306229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b0b8c-1e07-4193-bd99-45174238fde0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:43.309567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b0b8c-1e07-4193-bd99-45174238fde0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:43.314081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54732b6b-bf15-4f2d-849d-c2635f5cb749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:43.314925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732b6b-bf15-4f2d-849d-c2635f5cb749 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:43.315405 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732b6b-bf15-4f2d-849d-c2635f5cb749 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:43.315876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732b6b-bf15-4f2d-849d-c2635f5cb749 None admin] PATH_INFO: `/v3/users/03d71d1dd5394b76991f4fa1705c829c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:43.317199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54732b6b-bf15-4f2d-849d-c2635f5cb749 None admin] RBAC: Authorizing `identity:get_user(user_id=03d71d1dd5394b76991f4fa1705c829c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:43.319231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54732b6b-bf15-4f2d-849d-c2635f5cb749 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:43.321750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 60/118] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:43 2022] GET /identity/v3/users/03d71d1dd5394b76991f4fa1705c829c => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:43.323007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54732b6b-bf15-4f2d-849d-c2635f5cb749 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:43.434622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54732b6b-bf15-4f2d-849d-c2635f5cb749 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:43.440436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 59/119] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:07:43.441613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b0b8c-1e07-4193-bd99-45174238fde0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:43.470699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8dd7c-9a5e-4dd6-af4c-244e859a01f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:43.471768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8dd7c-9a5e-4dd6-af4c-244e859a01f7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:43.471768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8dd7c-9a5e-4dd6-af4c-244e859a01f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:43.472569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8dd7c-9a5e-4dd6-af4c-244e859a01f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:43.473392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8dd7c-9a5e-4dd6-af4c-244e859a01f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:43.473757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8dd7c-9a5e-4dd6-af4c-244e859a01f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:43.476067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8dd7c-9a5e-4dd6-af4c-244e859a01f7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:43.486740 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 61/120] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:43.487879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8dd7c-9a5e-4dd6-af4c-244e859a01f7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:43.547867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:43.557193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:43.563740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b0b8c-1e07-4193-bd99-45174238fde0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:43.603226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd2f84-2bcd-4647-a38d-8d542c62b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:43.604161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd2f84-2bcd-4647-a38d-8d542c62b28d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:43.604650 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd2f84-2bcd-4647-a38d-8d542c62b28d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:43.605097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd2f84-2bcd-4647-a38d-8d542c62b28d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:43.605341 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8dd7c-9a5e-4dd6-af4c-244e859a01f7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:43.646468 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d867e-6faf-404c-af70-336ee654056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:43.647456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d867e-6faf-404c-af70-336ee654056d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:43.647906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d867e-6faf-404c-af70-336ee654056d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:43.648375 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d867e-6faf-404c-af70-336ee654056d None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:43.650246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d867e-6faf-404c-af70-336ee654056d None admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:43.652001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d867e-6faf-404c-af70-336ee654056d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:43.653904 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 62/121] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:43 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:43.655522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d867e-6faf-404c-af70-336ee654056d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:43.695054 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd2f84-2bcd-4647-a38d-8d542c62b28d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:43.696630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd2f84-2bcd-4647-a38d-8d542c62b28d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:43.761864 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d867e-6faf-404c-af70-336ee654056d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:43.789304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:43.806858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160d76-a8e9-4878-a688-6c7cd7cd592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:43.807772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160d76-a8e9-4878-a688-6c7cd7cd592f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:43.808176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160d76-a8e9-4878-a688-6c7cd7cd592f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:43.808555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160d76-a8e9-4878-a688-6c7cd7cd592f None admin] PATH_INFO: `/v3/users/78bf1c78c35546668f4dd2fc9ca541d6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:43.809796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160d76-a8e9-4878-a688-6c7cd7cd592f None admin] RBAC: Authorizing `identity:get_user(user_id=78bf1c78c35546668f4dd2fc9ca541d6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:43.811634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160d76-a8e9-4878-a688-6c7cd7cd592f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:43.813491 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 63/122] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:43 2022] GET /identity/v3/users/78bf1c78c35546668f4dd2fc9ca541d6 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:43.814308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160d76-a8e9-4878-a688-6c7cd7cd592f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:43.829663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:43.838498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 60/123] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:07:43.839259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd2f84-2bcd-4647-a38d-8d542c62b28d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:43.939652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160d76-a8e9-4878-a688-6c7cd7cd592f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:43.939830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd2f84-2bcd-4647-a38d-8d542c62b28d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:43.976176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25fe8d-73d9-4245-b83d-2722d737fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:43.976787 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25fe8d-73d9-4245-b83d-2722d737fe57 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:43.977072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25fe8d-73d9-4245-b83d-2722d737fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:43.977349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25fe8d-73d9-4245-b83d-2722d737fe57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:43.978411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbdcad-d06b-4b83-bd64-633b7d41e573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:43.979351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbdcad-d06b-4b83-bd64-633b7d41e573 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:43.979933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbdcad-d06b-4b83-bd64-633b7d41e573 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:43.980433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbdcad-d06b-4b83-bd64-633b7d41e573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:43.981394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbdcad-d06b-4b83-bd64-633b7d41e573 None admin] RBAC: Adding query filter params (role.id=d742ebaf9dcb49d38c4758375c5ebd1f, scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4, user.id=78bf1c78c35546668f4dd2fc9ca541d6) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:43.981896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbdcad-d06b-4b83-bd64-633b7d41e573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:43.983548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbdcad-d06b-4b83-bd64-633b7d41e573 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:43.990073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 64/124] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:07:43 2022] GET /identity/v3/role_assignments?user.id=78bf1c78c35546668f4dd2fc9ca541d6&scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4&role.id=d742ebaf9dcb49d38c4758375c5ebd1f => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:43.991239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbdcad-d06b-4b83-bd64-633b7d41e573 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:44.059659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:44.098429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:44.103492 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25fe8d-73d9-4245-b83d-2722d737fe57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:44.104971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25fe8d-73d9-4245-b83d-2722d737fe57 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:44.112095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbdcad-d06b-4b83-bd64-633b7d41e573 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:44.151094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6890e75-660f-470b-af20-1a0db7d089ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:44.152586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6890e75-660f-470b-af20-1a0db7d089ee None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:44.153119 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6890e75-660f-470b-af20-1a0db7d089ee None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:44.153591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6890e75-660f-470b-af20-1a0db7d089ee None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:44.155084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6890e75-660f-470b-af20-1a0db7d089ee None admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:44.156813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6890e75-660f-470b-af20-1a0db7d089ee None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:44.158870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 65/125] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:43 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:44.165273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6890e75-660f-470b-af20-1a0db7d089ee None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:44.292606 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 61/126] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:07:44.297827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25fe8d-73d9-4245-b83d-2722d737fe57 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:44.333419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6890e75-660f-470b-af20-1a0db7d089ee None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:44.365283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:44.382803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd93916-c6fe-45e0-a9ca-a76a3c11869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:44.383460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd93916-c6fe-45e0-a9ca-a76a3c11869a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:44.383746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd93916-c6fe-45e0-a9ca-a76a3c11869a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:44.384026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd93916-c6fe-45e0-a9ca-a76a3c11869a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:44.384765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd93916-c6fe-45e0-a9ca-a76a3c11869a None admin] RBAC: Adding query filter params (role.id=58b61e8083c64fd58b3eb63efc4c7e3e, scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4, user.id=03d71d1dd5394b76991f4fa1705c829c) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:44.385648 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd93916-c6fe-45e0-a9ca-a76a3c11869a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:44.386578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd93916-c6fe-45e0-a9ca-a76a3c11869a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:44.393355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 66/127] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:07:44 2022] GET /identity/v3/role_assignments?user.id=03d71d1dd5394b76991f4fa1705c829c&scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4&role.id=58b61e8083c64fd58b3eb63efc4c7e3e => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:44.427240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25fe8d-73d9-4245-b83d-2722d737fe57 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:44.447542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:44.468457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba54250-5c7c-4a59-a330-8c3d7c40a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:44.469462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba54250-5c7c-4a59-a330-8c3d7c40a463 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:44.469956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba54250-5c7c-4a59-a330-8c3d7c40a463 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:44.470522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba54250-5c7c-4a59-a330-8c3d7c40a463 None admin] PATH_INFO: `/v3/projects/a6eea7e7abc1497a9e22891efa4129c7` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:44.472055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba54250-5c7c-4a59-a330-8c3d7c40a463 None admin] RBAC: Authorizing `identity:get_project(project_id=a6eea7e7abc1497a9e22891efa4129c7)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:44.473751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba54250-5c7c-4a59-a330-8c3d7c40a463 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:44.476101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 62/128] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:44 2022] GET /identity/v3/projects/a6eea7e7abc1497a9e22891efa4129c7 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:44.484393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd93916-c6fe-45e0-a9ca-a76a3c11869a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:44.602507 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd93916-c6fe-45e0-a9ca-a76a3c11869a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:44.646092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bb7a0-e645-4c6b-8a77-6bf34b6b1a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:44.646721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bb7a0-e645-4c6b-8a77-6bf34b6b1a5d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:44.647064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bb7a0-e645-4c6b-8a77-6bf34b6b1a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:44.647387 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bb7a0-e645-4c6b-8a77-6bf34b6b1a5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:44.648184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bb7a0-e645-4c6b-8a77-6bf34b6b1a5d None admin] RBAC: Adding query filter params (role.id=d446ff7289fd4718a77384fd80873ca4, scope.project.id=a6eea7e7abc1497a9e22891efa4129c7, user.id=78bf1c78c35546668f4dd2fc9ca541d6) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:44.648504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bb7a0-e645-4c6b-8a77-6bf34b6b1a5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:44.649967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bb7a0-e645-4c6b-8a77-6bf34b6b1a5d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:44.657151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 67/129] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:07:44 2022] GET /identity/v3/role_assignments?user.id=78bf1c78c35546668f4dd2fc9ca541d6&scope.project.id=a6eea7e7abc1497a9e22891efa4129c7&role.id=d446ff7289fd4718a77384fd80873ca4 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:44.739150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14163629-425a-4d3d-a4cd-3bc8c2c0bbc6 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:44.739529 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14163629-425a-4d3d-a4cd-3bc8c2c0bbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:44.739818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14163629-425a-4d3d-a4cd-3bc8c2c0bbc6 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:44.741373 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 63/130] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:44.746877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7b96-b18a-48db-befc-d490be8b0461 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:44.747180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7b96-b18a-48db-befc-d490be8b0461 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:44.747509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7b96-b18a-48db-befc-d490be8b0461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:44.766910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5bdb7b96-b18a-48db-befc-d490be8b0461 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:44.768199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5bdb7b96-b18a-48db-befc-d490be8b0461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:44.824956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:44.846476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 68/131] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:45.081135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03585fdc-11a7-44de-a4c3-1cbdc6cbe589 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:45.081951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03585fdc-11a7-44de-a4c3-1cbdc6cbe589 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:45.082231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03585fdc-11a7-44de-a4c3-1cbdc6cbe589 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:45.083780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 64/132] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:45.088734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf69967-6421-4db3-ad2d-0fddde27f99b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:45.089029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf69967-6421-4db3-ad2d-0fddde27f99b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:45.089337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf69967-6421-4db3-ad2d-0fddde27f99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:45.108095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-daf69967-6421-4db3-ad2d-0fddde27f99b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:45.109261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-daf69967-6421-4db3-ad2d-0fddde27f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:45.114587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03585fdc-11a7-44de-a4c3-1cbdc6cbe589 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:45.174925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 69/133] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:45.213316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03585fdc-11a7-44de-a4c3-1cbdc6cbe589 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:45.245802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dc3d4-55ca-4314-9c65-594bad841232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:45.246424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc3d4-55ca-4314-9c65-594bad841232 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:45.246705 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc3d4-55ca-4314-9c65-594bad841232 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:45.246979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc3d4-55ca-4314-9c65-594bad841232 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:45.248101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dc3d4-55ca-4314-9c65-594bad841232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:45.249524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dc3d4-55ca-4314-9c65-594bad841232 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:45.251052 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 65/134] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:45.256552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf69967-6421-4db3-ad2d-0fddde27f99b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:45.351581 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf69967-6421-4db3-ad2d-0fddde27f99b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:45.364986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:45.385144 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae968f-6286-4fe9-b0f1-9b834f5db420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:45.385746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae968f-6286-4fe9-b0f1-9b834f5db420 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:45.386032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae968f-6286-4fe9-b0f1-9b834f5db420 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:45.386309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae968f-6286-4fe9-b0f1-9b834f5db420 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:45.386951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae968f-6286-4fe9-b0f1-9b834f5db420 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:45.388421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae968f-6286-4fe9-b0f1-9b834f5db420 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:45.414340 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 70/135] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:07:45 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:45.442573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dc3d4-55ca-4314-9c65-594bad841232 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:45.481125 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:45.552182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dc3d4-55ca-4314-9c65-594bad841232 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:45.587957 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af930af3-bcad-4819-85ba-42c443f42b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:45.588602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af930af3-bcad-4819-85ba-42c443f42b4b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:45.588882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af930af3-bcad-4819-85ba-42c443f42b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:45.589157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af930af3-bcad-4819-85ba-42c443f42b4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:45.599243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af930af3-bcad-4819-85ba-42c443f42b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-af930af3-bcad-4819-85ba-42c443f42b4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:45.604130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:45.605111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:45.605877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 66/136] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:45.611036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae968f-6286-4fe9-b0f1-9b834f5db420 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:45.715772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae968f-6286-4fe9-b0f1-9b834f5db420 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:45.753272 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2eff0-acef-4f50-841a-cafcdb1683c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:45.754645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2eff0-acef-4f50-841a-cafcdb1683c1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:45.755067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2eff0-acef-4f50-841a-cafcdb1683c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:45.755508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2eff0-acef-4f50-841a-cafcdb1683c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:45.756406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2eff0-acef-4f50-841a-cafcdb1683c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:45.756711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2eff0-acef-4f50-841a-cafcdb1683c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:45.758132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2eff0-acef-4f50-841a-cafcdb1683c1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:45.767127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 71/137] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:45.772580 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af930af3-bcad-4819-85ba-42c443f42b4b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:45.877662 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:45.884680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af930af3-bcad-4819-85ba-42c443f42b4b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:45.921056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efde25-015e-4e49-9389-87563a9ee2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:45.921700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efde25-015e-4e49-9389-87563a9ee2df None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:45.921987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efde25-015e-4e49-9389-87563a9ee2df None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:45.922349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efde25-015e-4e49-9389-87563a9ee2df None admin] PATH_INFO: `/v3/users/5af68c235be44f65957b83b9b1f06afd` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:45.923561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efde25-015e-4e49-9389-87563a9ee2df None admin] RBAC: Authorizing `identity:get_user(user_id=5af68c235be44f65957b83b9b1f06afd)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:45.925598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efde25-015e-4e49-9389-87563a9ee2df None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:45.927373 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 67/138] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:45 2022] GET /identity/v3/users/5af68c235be44f65957b83b9b1f06afd => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:45.932718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2eff0-acef-4f50-841a-cafcdb1683c1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:45.967407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:46.042573 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2eff0-acef-4f50-841a-cafcdb1683c1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:46.087587 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5758115-6db3-47c9-84da-bbcbcb4f5aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:46.088541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5758115-6db3-47c9-84da-bbcbcb4f5aee None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:46.089028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5758115-6db3-47c9-84da-bbcbcb4f5aee None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:46.089531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5758115-6db3-47c9-84da-bbcbcb4f5aee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:46.161882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5758115-6db3-47c9-84da-bbcbcb4f5aee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:46.163770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5758115-6db3-47c9-84da-bbcbcb4f5aee None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:46.199257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:46.267925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 72/139] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:07:46.279383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efde25-015e-4e49-9389-87563a9ee2df None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:46.386050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efde25-015e-4e49-9389-87563a9ee2df None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:46.421928 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fece38-cfd7-4142-bbae-4ec6aead62f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:46.422909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fece38-cfd7-4142-bbae-4ec6aead62f7 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:46.423452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fece38-cfd7-4142-bbae-4ec6aead62f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:46.423950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fece38-cfd7-4142-bbae-4ec6aead62f7 None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:46.425845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fece38-cfd7-4142-bbae-4ec6aead62f7 None admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:46.427535 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fece38-cfd7-4142-bbae-4ec6aead62f7 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:46.429390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 68/140] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:46 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:46.435609 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5758115-6db3-47c9-84da-bbcbcb4f5aee None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:46.540834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5758115-6db3-47c9-84da-bbcbcb4f5aee None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:46.572211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:46.578977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ad881-8203-4ca1-b6b3-2fb2e35a4a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:46.579627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ad881-8203-4ca1-b6b3-2fb2e35a4a1b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:46.579913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ad881-8203-4ca1-b6b3-2fb2e35a4a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:46.580187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ad881-8203-4ca1-b6b3-2fb2e35a4a1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:46.580918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ad881-8203-4ca1-b6b3-2fb2e35a4a1b None admin] RBAC: Adding query filter params (role.id=a11998246b234a2a9156dcfbd29df373, scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4, user.id=5af68c235be44f65957b83b9b1f06afd) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:46.581227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ad881-8203-4ca1-b6b3-2fb2e35a4a1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:46.583242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ad881-8203-4ca1-b6b3-2fb2e35a4a1b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:46.589745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 73/141] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:07:46 2022] GET /identity/v3/role_assignments?user.id=5af68c235be44f65957b83b9b1f06afd&scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4&role.id=a11998246b234a2a9156dcfbd29df373 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:47.651945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f25f1-f25d-4db5-8ef2-2330db26f3bd None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:47.652476 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f25f1-f25d-4db5-8ef2-2330db26f3bd None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:47.652476 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f25f1-f25d-4db5-8ef2-2330db26f3bd None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:47.653977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 69/142] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:47.659996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670987-27a1-4c27-b253-7fa1223b000b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:47.660426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670987-27a1-4c27-b253-7fa1223b000b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:47.660568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670987-27a1-4c27-b253-7fa1223b000b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:47.679640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c6670987-27a1-4c27-b253-7fa1223b000b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:47.680828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c6670987-27a1-4c27-b253-7fa1223b000b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:47.750852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 74/143] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:47.877478 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80087fd-d187-4e61-b14f-fa6879070920 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:47.877842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80087fd-d187-4e61-b14f-fa6879070920 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:47.878045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80087fd-d187-4e61-b14f-fa6879070920 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:47.879593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 70/144] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:47.884466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9f77-fb24-4176-b4b9-26b10b9faabf None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:47.884757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9f77-fb24-4176-b4b9-26b10b9faabf None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:47.885032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9f77-fb24-4176-b4b9-26b10b9faabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:47.903116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-29aa9f77-fb24-4176-b4b9-26b10b9faabf None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:47.904254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-29aa9f77-fb24-4176-b4b9-26b10b9faabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:47.946548 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f2c2d-1068-43df-ac68-b3ca660506c4 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:47.946851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f2c2d-1068-43df-ac68-b3ca660506c4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:47.947102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f2c2d-1068-43df-ac68-b3ca660506c4 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:47.948897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 71/145] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:07:47.953619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb4c7-d26e-4e6e-9910-f3ec835ddbae None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:47.953917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb4c7-d26e-4e6e-9910-f3ec835ddbae None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:47.954195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb4c7-d26e-4e6e-9910-f3ec835ddbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:47.972463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 75/146] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:47.973304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4ebfb4c7-d26e-4e6e-9910-f3ec835ddbae None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:47.974560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4ebfb4c7-d26e-4e6e-9910-f3ec835ddbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:48.001856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:48.022775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa9f77-fb24-4176-b4b9-26b10b9faabf None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.047318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 72/147] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:07:48.089259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:48.133157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa9f77-fb24-4176-b4b9-26b10b9faabf None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:48.167148 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bc3e-dda9-44b6-8e95-d759f2aee622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:48.167741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bc3e-dda9-44b6-8e95-d759f2aee622 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:48.168025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bc3e-dda9-44b6-8e95-d759f2aee622 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:48.168299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bc3e-dda9-44b6-8e95-d759f2aee622 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:48.178339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2bc3e-dda9-44b6-8e95-d759f2aee622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-aea2bc3e-dda9-44b6-8e95-d759f2aee622 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:48.183184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:48.184109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:48.184920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 76/148] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:07:48.190101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfb4c7-d26e-4e6e-9910-f3ec835ddbae None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.236172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bc3e-dda9-44b6-8e95-d759f2aee622 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.288819 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfb4c7-d26e-4e6e-9910-f3ec835ddbae None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:48.323625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75495ba5-beb6-4fc7-bacb-f0cc1e0d0c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:48.324185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75495ba5-beb6-4fc7-bacb-f0cc1e0d0c4d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:48.324467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75495ba5-beb6-4fc7-bacb-f0cc1e0d0c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:48.324775 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75495ba5-beb6-4fc7-bacb-f0cc1e0d0c4d None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:48.325395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75495ba5-beb6-4fc7-bacb-f0cc1e0d0c4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:48.325698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75495ba5-beb6-4fc7-bacb-f0cc1e0d0c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:48.327115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75495ba5-beb6-4fc7-bacb-f0cc1e0d0c4d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:48.335315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 73/149] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:48.337387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75495ba5-beb6-4fc7-bacb-f0cc1e0d0c4d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.343642 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bc3e-dda9-44b6-8e95-d759f2aee622 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:48.360637 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:48.362307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:48.379687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdb209-cb15-4087-9611-80ed3ba4e8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:48.380319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdb209-cb15-4087-9611-80ed3ba4e8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:48.380600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdb209-cb15-4087-9611-80ed3ba4e8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:48.380877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdb209-cb15-4087-9611-80ed3ba4e8c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:48.390789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdb209-cb15-4087-9611-80ed3ba4e8c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-d1cdb209-cb15-4087-9611-80ed3ba4e8c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:48.395677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:48.396578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:48.397365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 77/150] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:07:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:07:48.398076 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdb209-cb15-4087-9611-80ed3ba4e8c1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.444102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75495ba5-beb6-4fc7-bacb-f0cc1e0d0c4d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:48.477422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76019c66-4233-4b5f-9d90-307985ffbb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:48.478054 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76019c66-4233-4b5f-9d90-307985ffbb5c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:48.478335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76019c66-4233-4b5f-9d90-307985ffbb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:48.478614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76019c66-4233-4b5f-9d90-307985ffbb5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:48.479787 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76019c66-4233-4b5f-9d90-307985ffbb5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:48.481214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76019c66-4233-4b5f-9d90-307985ffbb5c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:48.482767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 74/151] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:48.483550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76019c66-4233-4b5f-9d90-307985ffbb5c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.500016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdb209-cb15-4087-9611-80ed3ba4e8c1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:48.533178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b26588-8c07-4e56-921e-97d38503c7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:48.533811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26588-8c07-4e56-921e-97d38503c7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:48.534089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26588-8c07-4e56-921e-97d38503c7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:48.534860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26588-8c07-4e56-921e-97d38503c7e1 None admin] PATH_INFO: `/v3/users/4e7a68d4f74b45968c0b923a33216b3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:48.547493 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b26588-8c07-4e56-921e-97d38503c7e1 None admin] RBAC: Authorizing `identity:get_user(user_id=4e7a68d4f74b45968c0b923a33216b3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:48.549006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b26588-8c07-4e56-921e-97d38503c7e1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:48.551133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 78/152] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:48 2022] GET /identity/v3/users/4e7a68d4f74b45968c0b923a33216b3e => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:48.551912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b26588-8c07-4e56-921e-97d38503c7e1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.576269 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:48.585197 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76019c66-4233-4b5f-9d90-307985ffbb5c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:48.586894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:48.618111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29863f-4fca-4464-873f-fa59b32fef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:48.618720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29863f-4fca-4464-873f-fa59b32fef8f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:48.619002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29863f-4fca-4464-873f-fa59b32fef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:48.619300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29863f-4fca-4464-873f-fa59b32fef8f None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:48.619971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29863f-4fca-4464-873f-fa59b32fef8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:48.620276 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29863f-4fca-4464-873f-fa59b32fef8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:48.621645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29863f-4fca-4464-873f-fa59b32fef8f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:48.630502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 75/153] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:07:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:48.632273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29863f-4fca-4464-873f-fa59b32fef8f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.652752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b26588-8c07-4e56-921e-97d38503c7e1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:48.685613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed389548-880c-49d1-979e-f34d17566dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:48.686229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed389548-880c-49d1-979e-f34d17566dda None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:48.686479 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed389548-880c-49d1-979e-f34d17566dda None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:48.686749 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed389548-880c-49d1-979e-f34d17566dda None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:48.687436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed389548-880c-49d1-979e-f34d17566dda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:48.688858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed389548-880c-49d1-979e-f34d17566dda None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:48.709755 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 79/154] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:07:48 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:48.710491 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed389548-880c-49d1-979e-f34d17566dda None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.733630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29863f-4fca-4464-873f-fa59b32fef8f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:48.774281 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1410b4-c9af-491e-ba6d-a4115914fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:48.775686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1410b4-c9af-491e-ba6d-a4115914fce6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:48.776575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1410b4-c9af-491e-ba6d-a4115914fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:48.777132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1410b4-c9af-491e-ba6d-a4115914fce6 None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:48.778649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1410b4-c9af-491e-ba6d-a4115914fce6 None admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:48.781213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1410b4-c9af-491e-ba6d-a4115914fce6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:48.783331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 76/155] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:48 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:48.789383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1410b4-c9af-491e-ba6d-a4115914fce6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.818232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:48.826451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:48.837870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed389548-880c-49d1-979e-f34d17566dda None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:48.881347 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e5ea6-f03e-4e55-9f58-071daa8506b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:48.882171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e5ea6-f03e-4e55-9f58-071daa8506b5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:48.882454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e5ea6-f03e-4e55-9f58-071daa8506b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:48.882729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e5ea6-f03e-4e55-9f58-071daa8506b5 None admin] PATH_INFO: `/v3/users/4e7a68d4f74b45968c0b923a33216b3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:48.883897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e5ea6-f03e-4e55-9f58-071daa8506b5 None admin] RBAC: Authorizing `identity:get_user(user_id=4e7a68d4f74b45968c0b923a33216b3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:48.885355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e5ea6-f03e-4e55-9f58-071daa8506b5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:48.887111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 80/156] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:48 2022] GET /identity/v3/users/4e7a68d4f74b45968c0b923a33216b3e => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:48.892362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e5ea6-f03e-4e55-9f58-071daa8506b5 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:48.909017 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1410b4-c9af-491e-ba6d-a4115914fce6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:48.949990 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371a881-a8a4-4340-a971-bdc80dc7f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:48.950288 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a881-a8a4-4340-a971-bdc80dc7f66d None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:48.950576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a881-a8a4-4340-a971-bdc80dc7f66d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:48.950856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a881-a8a4-4340-a971-bdc80dc7f66d None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a/users/4e7a68d4f74b45968c0b923a33216b3e/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:48.952986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371a881-a8a4-4340-a971-bdc80dc7f66d None admin] RBAC: Authorizing `identity:create_grant(project_id=8d832454137d4955b3c10426d33bd15a, user_id=4e7a68d4f74b45968c0b923a33216b3e, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:48.954736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371a881-a8a4-4340-a971-bdc80dc7f66d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:48.972726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 77/157] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:07:48 2022] PUT /identity/v3/projects/8d832454137d4955b3c10426d33bd15a/users/4e7a68d4f74b45968c0b923a33216b3e/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:07:49.015094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e5ea6-f03e-4e55-9f58-071daa8506b5 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:49.063161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce078f-f2c1-43dd-91f0-4081fd2b2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:49.063812 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce078f-f2c1-43dd-91f0-4081fd2b2b69 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:49.064050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce078f-f2c1-43dd-91f0-4081fd2b2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:49.064344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce078f-f2c1-43dd-91f0-4081fd2b2b69 None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:49.067748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce078f-f2c1-43dd-91f0-4081fd2b2b69 None admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:49.069180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce078f-f2c1-43dd-91f0-4081fd2b2b69 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:49.071112 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 81/158] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:48 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:49.077624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371a881-a8a4-4340-a971-bdc80dc7f66d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:49.182547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:49.206263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371a881-a8a4-4340-a971-bdc80dc7f66d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:49.245032 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fb5f9-a5ab-4574-8ab0-8a714b2667db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:49.245978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb5f9-a5ab-4574-8ab0-8a714b2667db None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:49.246403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb5f9-a5ab-4574-8ab0-8a714b2667db None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:49.246820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb5f9-a5ab-4574-8ab0-8a714b2667db None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a/users/4e7a68d4f74b45968c0b923a33216b3e/roles/d742ebaf9dcb49d38c4758375c5ebd1f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:49.249183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fb5f9-a5ab-4574-8ab0-8a714b2667db None admin] RBAC: Authorizing `identity:create_grant(project_id=8d832454137d4955b3c10426d33bd15a, user_id=4e7a68d4f74b45968c0b923a33216b3e, role_id=d742ebaf9dcb49d38c4758375c5ebd1f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:49.250770 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fb5f9-a5ab-4574-8ab0-8a714b2667db None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:49.265287 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 78/159] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:07:49 2022] PUT /identity/v3/projects/8d832454137d4955b3c10426d33bd15a/users/4e7a68d4f74b45968c0b923a33216b3e/roles/d742ebaf9dcb49d38c4758375c5ebd1f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:07:51.030463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570add3-7d72-4415-825f-6e3d09ba2531 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.031020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570add3-7d72-4415-825f-6e3d09ba2531 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.031020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570add3-7d72-4415-825f-6e3d09ba2531 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.032422 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 82/160] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:51.038812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100804d-0328-4e81-80ab-2e686aa0b7ac None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.039323 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100804d-0328-4e81-80ab-2e686aa0b7ac None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.039421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100804d-0328-4e81-80ab-2e686aa0b7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.064843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8100804d-0328-4e81-80ab-2e686aa0b7ac None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:51.066409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8100804d-0328-4e81-80ab-2e686aa0b7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:51.142688 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 79/161] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:51.145754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aed8e-96f9-4550-be4e-0e9c1cad7fdc None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.146046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aed8e-96f9-4550-be4e-0e9c1cad7fdc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.146324 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aed8e-96f9-4550-be4e-0e9c1cad7fdc None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.147689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 83/162] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:51.153117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d6010-0563-4bad-beec-61966085c08a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.153656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d6010-0563-4bad-beec-61966085c08a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.154145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d6010-0563-4bad-beec-61966085c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.173590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-470d6010-0563-4bad-beec-61966085c08a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:51.175171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-470d6010-0563-4bad-beec-61966085c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:51.200163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e898-acee-4075-a3c2-90d068f4a5b5 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.200447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e898-acee-4075-a3c2-90d068f4a5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.200733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e898-acee-4075-a3c2-90d068f4a5b5 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.202199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 84/163] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:51.209813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd850e36-1e05-4b25-ad11-a18e34c720fb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.210315 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd850e36-1e05-4b25-ad11-a18e34c720fb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.210783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd850e36-1e05-4b25-ad11-a18e34c720fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.234123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-dd850e36-1e05-4b25-ad11-a18e34c720fb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:51.236243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dd850e36-1e05-4b25-ad11-a18e34c720fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:51.249207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 80/164] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:51.261197 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:51.311301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 85/165] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:07:51.425934 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d6010-0563-4bad-beec-61966085c08a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:51.428909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:51.434819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cb25-32c9-4fae-93a4-738442d94f09 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.435455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cb25-32c9-4fae-93a4-738442d94f09 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.435970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096cb25-32c9-4fae-93a4-738442d94f09 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.437880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 86/166] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:51.445001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cfb92-89f0-4f7f-9f24-f070db14052c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.445478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cfb92-89f0-4f7f-9f24-f070db14052c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.445953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cfb92-89f0-4f7f-9f24-f070db14052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.465420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-357cfb92-89f0-4f7f-9f24-f070db14052c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:51.466833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-357cfb92-89f0-4f7f-9f24-f070db14052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:51.542441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d6010-0563-4bad-beec-61966085c08a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:51.548196 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 87/167] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:07:51.548897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cfb92-89f0-4f7f-9f24-f070db14052c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:51.592067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e942e-3255-4c8c-b2fe-9f8989d6fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:51.592616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e942e-3255-4c8c-b2fe-9f8989d6fe5b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.592894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e942e-3255-4c8c-b2fe-9f8989d6fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.593167 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e942e-3255-4c8c-b2fe-9f8989d6fe5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.607873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e942e-3255-4c8c-b2fe-9f8989d6fe5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-329e942e-3255-4c8c-b2fe-9f8989d6fe5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:51.613363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:51.614217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:51.614988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 81/168] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:51.616243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e942e-3255-4c8c-b2fe-9f8989d6fe5b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:51.651294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:51.668542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cfb92-89f0-4f7f-9f24-f070db14052c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:51.678753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:51.705942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30638d65-06fe-4a67-8c88-ed058bebf073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:51.707183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30638d65-06fe-4a67-8c88-ed058bebf073 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.707490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30638d65-06fe-4a67-8c88-ed058bebf073 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.707832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30638d65-06fe-4a67-8c88-ed058bebf073 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.709153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30638d65-06fe-4a67-8c88-ed058bebf073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:51.710586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30638d65-06fe-4a67-8c88-ed058bebf073 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:51.715317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 88/169] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:51.715317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30638d65-06fe-4a67-8c88-ed058bebf073 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:51.720943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e942e-3255-4c8c-b2fe-9f8989d6fe5b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:51.763102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40da274-6791-4239-9a01-9bf49dfae8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:51.763754 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40da274-6791-4239-9a01-9bf49dfae8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.764146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40da274-6791-4239-9a01-9bf49dfae8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.764415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40da274-6791-4239-9a01-9bf49dfae8f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.774943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40da274-6791-4239-9a01-9bf49dfae8f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-d40da274-6791-4239-9a01-9bf49dfae8f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:51.779827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:51.780680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 82/170] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:07:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:51.784163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40da274-6791-4239-9a01-9bf49dfae8f8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:51.827558 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30638d65-06fe-4a67-8c88-ed058bebf073 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:51.860085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d746471-35da-4aba-878f-bb4cd4343fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:51.860633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d746471-35da-4aba-878f-bb4cd4343fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.860912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d746471-35da-4aba-878f-bb4cd4343fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.861191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d746471-35da-4aba-878f-bb4cd4343fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.861854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d746471-35da-4aba-878f-bb4cd4343fa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:51.862157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d746471-35da-4aba-878f-bb4cd4343fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:51.864089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d746471-35da-4aba-878f-bb4cd4343fa3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:51.871877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 89/171] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:51.876410 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d746471-35da-4aba-878f-bb4cd4343fa3 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:51.886483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40da274-6791-4239-9a01-9bf49dfae8f8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:51.890484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:51.910122 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:51.921664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff154f8-7dbb-4fe1-840b-de4c19c84fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:51.922269 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff154f8-7dbb-4fe1-840b-de4c19c84fb8 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:51.922550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff154f8-7dbb-4fe1-840b-de4c19c84fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:51.922820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff154f8-7dbb-4fe1-840b-de4c19c84fb8 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:51.923501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff154f8-7dbb-4fe1-840b-de4c19c84fb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:51.924919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff154f8-7dbb-4fe1-840b-de4c19c84fb8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:51.945185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 83/172] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:07:51 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:07:51.945991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff154f8-7dbb-4fe1-840b-de4c19c84fb8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:51.994357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d746471-35da-4aba-878f-bb4cd4343fa3 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:52.031862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802fab9-5a98-43ae-9881-09ee5a72a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:52.032509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802fab9-5a98-43ae-9881-09ee5a72a394 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:52.032761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802fab9-5a98-43ae-9881-09ee5a72a394 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:52.033039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802fab9-5a98-43ae-9881-09ee5a72a394 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:52.033723 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802fab9-5a98-43ae-9881-09ee5a72a394 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:52.034032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802fab9-5a98-43ae-9881-09ee5a72a394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:52.036060 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802fab9-5a98-43ae-9881-09ee5a72a394 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:52.048660 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 90/173] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:52.049545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802fab9-5a98-43ae-9881-09ee5a72a394 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:52.074014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff154f8-7dbb-4fe1-840b-de4c19c84fb8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:52.111867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bd942-9743-4a6a-9b96-8506f61cd92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:52.112427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd942-9743-4a6a-9b96-8506f61cd92d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:52.112733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd942-9743-4a6a-9b96-8506f61cd92d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:52.113005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd942-9743-4a6a-9b96-8506f61cd92d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:52.127170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bd942-9743-4a6a-9b96-8506f61cd92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-7c8bd942-9743-4a6a-9b96-8506f61cd92d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:52.134376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:52.135349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 84/174] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:07:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:52.136137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bd942-9743-4a6a-9b96-8506f61cd92d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:52.145340 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:52.176598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802fab9-5a98-43ae-9881-09ee5a72a394 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:52.189746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:52.222156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aeec5-a896-47fe-bff1-4c33c359ef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:52.222773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aeec5-a896-47fe-bff1-4c33c359ef55 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:52.223054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aeec5-a896-47fe-bff1-4c33c359ef55 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:52.223370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aeec5-a896-47fe-bff1-4c33c359ef55 None admin] PATH_INFO: `/v3/users/1164c321e8f642f0ae90548f5aedc3e6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:52.240041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aeec5-a896-47fe-bff1-4c33c359ef55 None admin] RBAC: Authorizing `identity:get_user(user_id=1164c321e8f642f0ae90548f5aedc3e6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:52.241524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aeec5-a896-47fe-bff1-4c33c359ef55 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:52.243220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 91/175] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:52 2022] GET /identity/v3/users/1164c321e8f642f0ae90548f5aedc3e6 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:52.245211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aeec5-a896-47fe-bff1-4c33c359ef55 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:52.276842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bd942-9743-4a6a-9b96-8506f61cd92d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:52.318503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a8601-1b1f-43c9-b99d-82a456d8aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:52.319156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8601-1b1f-43c9-b99d-82a456d8aea3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:52.319461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8601-1b1f-43c9-b99d-82a456d8aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:52.319741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a8601-1b1f-43c9-b99d-82a456d8aea3 None admin] PATH_INFO: `/v3/users/4e7a68d4f74b45968c0b923a33216b3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:52.321338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a8601-1b1f-43c9-b99d-82a456d8aea3 None admin] RBAC: Authorizing `identity:get_user(user_id=4e7a68d4f74b45968c0b923a33216b3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:52.323238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a8601-1b1f-43c9-b99d-82a456d8aea3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:52.328544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 85/176] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:52 2022] GET /identity/v3/users/4e7a68d4f74b45968c0b923a33216b3e => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:52.328544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a8601-1b1f-43c9-b99d-82a456d8aea3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:52.371711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aeec5-a896-47fe-bff1-4c33c359ef55 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:52.408745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe9ee6-0c7a-4ddb-9607-54297dddec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:52.409426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9ee6-0c7a-4ddb-9607-54297dddec72 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:52.409779 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9ee6-0c7a-4ddb-9607-54297dddec72 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:52.410124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9ee6-0c7a-4ddb-9607-54297dddec72 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:52.410887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe9ee6-0c7a-4ddb-9607-54297dddec72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:52.411259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe9ee6-0c7a-4ddb-9607-54297dddec72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:52.412802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe9ee6-0c7a-4ddb-9607-54297dddec72 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:52.415536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:52.423622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 92/177] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:07:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:52.424611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe9ee6-0c7a-4ddb-9607-54297dddec72 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:52.452319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a8601-1b1f-43c9-b99d-82a456d8aea3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:52.461415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:52.494069 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fd199-3577-458d-a6f4-a7ceff597862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:52.494708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd199-3577-458d-a6f4-a7ceff597862 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:52.495043 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd199-3577-458d-a6f4-a7ceff597862 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:52.495245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd199-3577-458d-a6f4-a7ceff597862 None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:52.497139 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fd199-3577-458d-a6f4-a7ceff597862 None admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:52.498976 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fd199-3577-458d-a6f4-a7ceff597862 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:52.500925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 86/178] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:52 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:52.501739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fd199-3577-458d-a6f4-a7ceff597862 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:52.549908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe9ee6-0c7a-4ddb-9607-54297dddec72 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:52.596159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be1f6-d0d5-48cf-9868-ed84775854f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:52.597458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be1f6-d0d5-48cf-9868-ed84775854f6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:52.598161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be1f6-d0d5-48cf-9868-ed84775854f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:52.598622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be1f6-d0d5-48cf-9868-ed84775854f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:52.620089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fd199-3577-458d-a6f4-a7ceff597862 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:52.658187 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c09a11-4355-4383-835f-cfbef19db9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:52.658856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09a11-4355-4383-835f-cfbef19db9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:52.660001 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09a11-4355-4383-835f-cfbef19db9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:52.660370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09a11-4355-4383-835f-cfbef19db9e3 None admin] PATH_INFO: `/v3/users/4e7a68d4f74b45968c0b923a33216b3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:52.661729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c09a11-4355-4383-835f-cfbef19db9e3 None admin] RBAC: Authorizing `identity:get_user(user_id=4e7a68d4f74b45968c0b923a33216b3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:52.663339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c09a11-4355-4383-835f-cfbef19db9e3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:52.665002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 87/179] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:52 2022] GET /identity/v3/users/4e7a68d4f74b45968c0b923a33216b3e => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:52.665817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c09a11-4355-4383-835f-cfbef19db9e3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:52.684828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22be1f6-d0d5-48cf-9868-ed84775854f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:52.687019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22be1f6-d0d5-48cf-9868-ed84775854f6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:52.715701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:52.736482 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:52.783835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c09a11-4355-4383-835f-cfbef19db9e3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:52.819408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 93/180] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:07:52.820972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be1f6-d0d5-48cf-9868-ed84775854f6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:52.827810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64c33-e1ea-4dde-81c7-1a19f0e08e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:52.828562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64c33-e1ea-4dde-81c7-1a19f0e08e55 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:52.828912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64c33-e1ea-4dde-81c7-1a19f0e08e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:52.829267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64c33-e1ea-4dde-81c7-1a19f0e08e55 None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a/users/1164c321e8f642f0ae90548f5aedc3e6/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:52.831439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b64c33-e1ea-4dde-81c7-1a19f0e08e55 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d832454137d4955b3c10426d33bd15a, user_id=1164c321e8f642f0ae90548f5aedc3e6, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:52.833149 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b64c33-e1ea-4dde-81c7-1a19f0e08e55 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:52.849656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 88/181] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:07:52 2022] PUT /identity/v3/projects/8d832454137d4955b3c10426d33bd15a/users/1164c321e8f642f0ae90548f5aedc3e6/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:07:52.850911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64c33-e1ea-4dde-81c7-1a19f0e08e55 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:53.019401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:53.025057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be1f6-d0d5-48cf-9868-ed84775854f6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:53.057661 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64c33-e1ea-4dde-81c7-1a19f0e08e55 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:53.059234 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:53.077823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171d8a3-1a6b-4d69-b9c0-f4550ed07ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:53.078848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171d8a3-1a6b-4d69-b9c0-f4550ed07ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:53.079245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171d8a3-1a6b-4d69-b9c0-f4550ed07ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:53.079687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171d8a3-1a6b-4d69-b9c0-f4550ed07ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:53.101643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638e74d-4218-4125-9889-0fc56b4b89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:53.102439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638e74d-4218-4125-9889-0fc56b4b89ef None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:53.102724 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638e74d-4218-4125-9889-0fc56b4b89ef None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:53.103003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638e74d-4218-4125-9889-0fc56b4b89ef None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:53.104272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638e74d-4218-4125-9889-0fc56b4b89ef None admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:53.105750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638e74d-4218-4125-9889-0fc56b4b89ef None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:53.107557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 89/182] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:52 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:53.116242 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638e74d-4218-4125-9889-0fc56b4b89ef None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:53.186906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171d8a3-1a6b-4d69-b9c0-f4550ed07ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:53.188727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171d8a3-1a6b-4d69-b9c0-f4550ed07ec1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:53.285130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638e74d-4218-4125-9889-0fc56b4b89ef None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:53.332199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3d31-f16e-45c6-8c1b-680d80a2375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:53.333432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3d31-f16e-45c6-8c1b-680d80a2375b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:53.334705 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3d31-f16e-45c6-8c1b-680d80a2375b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:53.335434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3d31-f16e-45c6-8c1b-680d80a2375b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:53.337156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3d31-f16e-45c6-8c1b-680d80a2375b None admin] RBAC: Adding query filter params (role.id=58b61e8083c64fd58b3eb63efc4c7e3e, scope.project.id=8d832454137d4955b3c10426d33bd15a, user.id=4e7a68d4f74b45968c0b923a33216b3e) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:53.337916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3d31-f16e-45c6-8c1b-680d80a2375b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:53.340642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3d31-f16e-45c6-8c1b-680d80a2375b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:53.364774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 90/183] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:07:53 2022] GET /identity/v3/role_assignments?user.id=4e7a68d4f74b45968c0b923a33216b3e&scope.project.id=8d832454137d4955b3c10426d33bd15a&role.id=58b61e8083c64fd58b3eb63efc4c7e3e => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:53.385743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:53.391949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 94/184] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:07:53.400461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3d31-f16e-45c6-8c1b-680d80a2375b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:53.449010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:53.537475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3d31-f16e-45c6-8c1b-680d80a2375b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:53.582011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7f5ee-6499-408f-9d82-11abfd67259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:53.582664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7f5ee-6499-408f-9d82-11abfd67259e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:53.582947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7f5ee-6499-408f-9d82-11abfd67259e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:53.583226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7f5ee-6499-408f-9d82-11abfd67259e None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:53.591132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7f5ee-6499-408f-9d82-11abfd67259e None admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:53.591132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7f5ee-6499-408f-9d82-11abfd67259e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:53.591132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 91/185] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:53 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:53.597699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171d8a3-1a6b-4d69-b9c0-f4550ed07ec1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:53.724792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171d8a3-1a6b-4d69-b9c0-f4550ed07ec1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:53.765384 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4110b70-da0b-4f98-b8ab-eb868d7f7401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:53.766398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4110b70-da0b-4f98-b8ab-eb868d7f7401 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:53.766877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4110b70-da0b-4f98-b8ab-eb868d7f7401 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:53.767417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4110b70-da0b-4f98-b8ab-eb868d7f7401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:53.768371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4110b70-da0b-4f98-b8ab-eb868d7f7401 None admin] RBAC: Adding query filter params (role.id=d742ebaf9dcb49d38c4758375c5ebd1f, scope.project.id=8d832454137d4955b3c10426d33bd15a, user.id=4e7a68d4f74b45968c0b923a33216b3e) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:53.769513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4110b70-da0b-4f98-b8ab-eb868d7f7401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:53.771151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4110b70-da0b-4f98-b8ab-eb868d7f7401 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:53.777886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 95/186] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:07:53 2022] GET /identity/v3/role_assignments?user.id=4e7a68d4f74b45968c0b923a33216b3e&scope.project.id=8d832454137d4955b3c10426d33bd15a&role.id=d742ebaf9dcb49d38c4758375c5ebd1f => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:54.368266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918603a-2187-4267-9d06-f36b01433a81 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:54.368762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918603a-2187-4267-9d06-f36b01433a81 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:54.368762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918603a-2187-4267-9d06-f36b01433a81 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:54.370295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 92/187] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:54.375945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83999a3-6724-4ef3-ab19-29be9bce361a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:54.376479 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83999a3-6724-4ef3-ab19-29be9bce361a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:54.376479 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83999a3-6724-4ef3-ab19-29be9bce361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:54.396775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e83999a3-6724-4ef3-ab19-29be9bce361a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:54.397972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e83999a3-6724-4ef3-ab19-29be9bce361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:54.455166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:54.467598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 96/188] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:54.482759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68e56-256e-448f-ba82-61e498a5506b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:54.483047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68e56-256e-448f-ba82-61e498a5506b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:54.483355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68e56-256e-448f-ba82-61e498a5506b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:54.484807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 93/189] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:54.489584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0bbc7-7fae-4e60-a509-0c0260fa81f4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:54.489870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0bbc7-7fae-4e60-a509-0c0260fa81f4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:54.490149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0bbc7-7fae-4e60-a509-0c0260fa81f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:54.508427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5ab0bbc7-7fae-4e60-a509-0c0260fa81f4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:54.509582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5ab0bbc7-7fae-4e60-a509-0c0260fa81f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:54.576067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 97/190] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:54.735064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb68e56-256e-448f-ba82-61e498a5506b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:54.840684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb68e56-256e-448f-ba82-61e498a5506b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:54.840868 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0bbc7-7fae-4e60-a509-0c0260fa81f4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:54.842227 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:54.881112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebb60a-8422-40dc-9376-1c29d93515fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:54.881861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb60a-8422-40dc-9376-1c29d93515fc None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:54.882559 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb60a-8422-40dc-9376-1c29d93515fc None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:54.882832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb60a-8422-40dc-9376-1c29d93515fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:54.894809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebb60a-8422-40dc-9376-1c29d93515fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-ddebb60a-8422-40dc-9376-1c29d93515fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:54.901150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:54.902012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:54.903673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 94/191] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:54.908459 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebb60a-8422-40dc-9376-1c29d93515fc None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:54.948777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0bbc7-7fae-4e60-a509-0c0260fa81f4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:54.974376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:54.987125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87202937-1697-49c4-8e5c-56cbaffdb094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:54.988374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202937-1697-49c4-8e5c-56cbaffdb094 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:54.988651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202937-1697-49c4-8e5c-56cbaffdb094 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:54.988923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202937-1697-49c4-8e5c-56cbaffdb094 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:54.990170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87202937-1697-49c4-8e5c-56cbaffdb094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:54.991819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87202937-1697-49c4-8e5c-56cbaffdb094 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:54.993804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 98/192] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:54.998908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87202937-1697-49c4-8e5c-56cbaffdb094 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:55.011661 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebb60a-8422-40dc-9376-1c29d93515fc None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:55.045481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673e6af-d9d3-44ab-a4ad-67d613f39a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:55.046096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e6af-d9d3-44ab-a4ad-67d613f39a92 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:55.046365 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e6af-d9d3-44ab-a4ad-67d613f39a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:55.046663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673e6af-d9d3-44ab-a4ad-67d613f39a92 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:55.050804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e6af-d9d3-44ab-a4ad-67d613f39a92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:55.050804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e6af-d9d3-44ab-a4ad-67d613f39a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:55.050804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673e6af-d9d3-44ab-a4ad-67d613f39a92 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:55.065336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 95/193] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:55.070747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673e6af-d9d3-44ab-a4ad-67d613f39a92 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:55.103375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:55.116610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87202937-1697-49c4-8e5c-56cbaffdb094 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:55.153403 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85301b-2282-464b-9cd1-314fce0bf296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:55.154009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85301b-2282-464b-9cd1-314fce0bf296 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:55.154290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85301b-2282-464b-9cd1-314fce0bf296 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:55.154563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85301b-2282-464b-9cd1-314fce0bf296 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:55.155301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85301b-2282-464b-9cd1-314fce0bf296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:55.156741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85301b-2282-464b-9cd1-314fce0bf296 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:55.180561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 99/194] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:07:54 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:07:55.190944 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673e6af-d9d3-44ab-a4ad-67d613f39a92 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:55.229138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ced1b-4ace-446d-aea1-902fbda0751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:55.229875 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ced1b-4ace-446d-aea1-902fbda0751a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:55.230164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ced1b-4ace-446d-aea1-902fbda0751a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:55.230444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ced1b-4ace-446d-aea1-902fbda0751a None admin] PATH_INFO: `/v3/users/ecebe870dd824f4b94f41c62a8b3f584` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:55.231212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8597213-6c62-40a5-99c0-e0468c207dae None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:55.231547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8597213-6c62-40a5-99c0-e0468c207dae None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:55.231827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8597213-6c62-40a5-99c0-e0468c207dae None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:55.233397 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 100/195] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:07:55.239699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50fc48-3030-4983-baa5-ed40929d9b0b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:55.239971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50fc48-3030-4983-baa5-ed40929d9b0b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:55.240179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50fc48-3030-4983-baa5-ed40929d9b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:55.249087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ced1b-4ace-446d-aea1-902fbda0751a None admin] RBAC: Authorizing `identity:get_user(user_id=ecebe870dd824f4b94f41c62a8b3f584)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:55.250576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ced1b-4ace-446d-aea1-902fbda0751a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:55.252489 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 96/196] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:55 2022] GET /identity/v3/users/ecebe870dd824f4b94f41c62a8b3f584 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:55.258289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ced1b-4ace-446d-aea1-902fbda0751a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:55.259836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1d50fc48-3030-4983-baa5-ed40929d9b0b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:55.261077 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1d50fc48-3030-4983-baa5-ed40929d9b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:55.307223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:55.337286 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 101/197] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:07:55.352931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:55.372776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ced1b-4ace-446d-aea1-902fbda0751a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:55.407416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f408c25-7875-4dfd-a821-385d5e57d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:55.408322 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f408c25-7875-4dfd-a821-385d5e57d881 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:55.408601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f408c25-7875-4dfd-a821-385d5e57d881 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:55.408874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f408c25-7875-4dfd-a821-385d5e57d881 None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:55.410015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f408c25-7875-4dfd-a821-385d5e57d881 None admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:55.411517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f408c25-7875-4dfd-a821-385d5e57d881 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:55.413136 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 97/198] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:55 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:55.418848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50fc48-3030-4983-baa5-ed40929d9b0b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:55.528192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50fc48-3030-4983-baa5-ed40929d9b0b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:55.565784 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01444d-e316-48de-acc6-64c9a8ae6ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:55.566464 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01444d-e316-48de-acc6-64c9a8ae6ff8 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:55.566747 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01444d-e316-48de-acc6-64c9a8ae6ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:55.567019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01444d-e316-48de-acc6-64c9a8ae6ff8 None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a/users/ecebe870dd824f4b94f41c62a8b3f584/roles/a11998246b234a2a9156dcfbd29df373` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:55.568997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01444d-e316-48de-acc6-64c9a8ae6ff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d832454137d4955b3c10426d33bd15a, user_id=ecebe870dd824f4b94f41c62a8b3f584, role_id=a11998246b234a2a9156dcfbd29df373)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:55.570456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01444d-e316-48de-acc6-64c9a8ae6ff8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:55.588095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 102/199] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:07:55 2022] PUT /identity/v3/projects/8d832454137d4955b3c10426d33bd15a/users/ecebe870dd824f4b94f41c62a8b3f584/roles/a11998246b234a2a9156dcfbd29df373 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:07:55.620921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f408c25-7875-4dfd-a821-385d5e57d881 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:55.735750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f408c25-7875-4dfd-a821-385d5e57d881 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:55.775686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdcbbd-413b-4194-9e70-865d9cd9297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:55.776671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdcbbd-413b-4194-9e70-865d9cd9297a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:55.777150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdcbbd-413b-4194-9e70-865d9cd9297a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:55.777623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdcbbd-413b-4194-9e70-865d9cd9297a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:55.789158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdcbbd-413b-4194-9e70-865d9cd9297a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-79bdcbbd-413b-4194-9e70-865d9cd9297a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:55.794429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:55.795451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:55.796260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:07:55.801638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 98/200] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:55.803344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01444d-e316-48de-acc6-64c9a8ae6ff8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:55.844568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:55.916695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01444d-e316-48de-acc6-64c9a8ae6ff8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:55.955687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b880d-7c0b-41e0-97be-d3353f431fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:55.956370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b880d-7c0b-41e0-97be-d3353f431fcd None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:55.957150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b880d-7c0b-41e0-97be-d3353f431fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:55.957424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b880d-7c0b-41e0-97be-d3353f431fcd None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:55.958085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b880d-7c0b-41e0-97be-d3353f431fcd None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:55.958382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b880d-7c0b-41e0-97be-d3353f431fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:55.959775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b880d-7c0b-41e0-97be-d3353f431fcd None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:55.968243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 103/201] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:55.974019 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdcbbd-413b-4194-9e70-865d9cd9297a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:55.986839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:56.087307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdcbbd-413b-4194-9e70-865d9cd9297a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:56.130116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a45fe-35ed-4d08-8851-420b0ebd50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:56.130754 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a45fe-35ed-4d08-8851-420b0ebd50d5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:56.131036 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a45fe-35ed-4d08-8851-420b0ebd50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:56.131338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a45fe-35ed-4d08-8851-420b0ebd50d5 None admin] PATH_INFO: `/v3/users/1164c321e8f642f0ae90548f5aedc3e6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:56.132494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a45fe-35ed-4d08-8851-420b0ebd50d5 None admin] RBAC: Authorizing `identity:get_user(user_id=1164c321e8f642f0ae90548f5aedc3e6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:56.134072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a45fe-35ed-4d08-8851-420b0ebd50d5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:56.136059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 99/202] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:55 2022] GET /identity/v3/users/1164c321e8f642f0ae90548f5aedc3e6 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:56.141189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b880d-7c0b-41e0-97be-d3353f431fcd None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:56.241825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:56.245726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b880d-7c0b-41e0-97be-d3353f431fcd None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:56.289839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6956b85-9c29-4770-8382-d637d8b435ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:56.290548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6956b85-9c29-4770-8382-d637d8b435ff None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:56.290833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6956b85-9c29-4770-8382-d637d8b435ff None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:56.291110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6956b85-9c29-4770-8382-d637d8b435ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:56.365661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6956b85-9c29-4770-8382-d637d8b435ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:56.367103 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6956b85-9c29-4770-8382-d637d8b435ff None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:56.468428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:56.476977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 104/203] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:07:56.480339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a45fe-35ed-4d08-8851-420b0ebd50d5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:56.557824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:56.580782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a45fe-35ed-4d08-8851-420b0ebd50d5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:56.616625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe12d0-d116-4693-adef-bc2ea7f3383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:56.617171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe12d0-d116-4693-adef-bc2ea7f3383b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:56.617442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe12d0-d116-4693-adef-bc2ea7f3383b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:56.617711 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe12d0-d116-4693-adef-bc2ea7f3383b None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:56.618881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe12d0-d116-4693-adef-bc2ea7f3383b None admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:56.620340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe12d0-d116-4693-adef-bc2ea7f3383b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:56.622350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 100/204] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:56 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:56.628777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6956b85-9c29-4770-8382-d637d8b435ff None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:56.731532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6956b85-9c29-4770-8382-d637d8b435ff None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:56.766551 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8675-2ea1-4e39-a399-87aa283ae04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:56.767154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8675-2ea1-4e39-a399-87aa283ae04b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:56.767462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8675-2ea1-4e39-a399-87aa283ae04b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:56.767734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8675-2ea1-4e39-a399-87aa283ae04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:56.768454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8675-2ea1-4e39-a399-87aa283ae04b None admin] RBAC: Adding query filter params (role.id=d446ff7289fd4718a77384fd80873ca4, scope.project.id=8d832454137d4955b3c10426d33bd15a, user.id=1164c321e8f642f0ae90548f5aedc3e6) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:56.768796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8675-2ea1-4e39-a399-87aa283ae04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:56.770818 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8675-2ea1-4e39-a399-87aa283ae04b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:56.776972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 105/205] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:07:56 2022] GET /identity/v3/role_assignments?user.id=1164c321e8f642f0ae90548f5aedc3e6&scope.project.id=8d832454137d4955b3c10426d33bd15a&role.id=d446ff7289fd4718a77384fd80873ca4 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:57.588236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb89c87-58d6-479b-a876-c52aa2da29b0 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:57.588746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb89c87-58d6-479b-a876-c52aa2da29b0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:57.588819 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb89c87-58d6-479b-a876-c52aa2da29b0 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:57.590106 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 101/206] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:57.595323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefef008-a1d0-4722-8dc7-f113a79c3c3a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:57.595702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefef008-a1d0-4722-8dc7-f113a79c3c3a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:57.595858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefef008-a1d0-4722-8dc7-f113a79c3c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:57.614670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-eefef008-a1d0-4722-8dc7-f113a79c3c3a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:57.615881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-eefef008-a1d0-4722-8dc7-f113a79c3c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:57.641769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a4408-7972-4818-a0e6-35f4cc16bb5c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:57.642049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a4408-7972-4818-a0e6-35f4cc16bb5c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:57.642325 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a4408-7972-4818-a0e6-35f4cc16bb5c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:57.644372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 102/207] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:07:57.648920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b729f-2e57-4275-a323-5c6bd446cace None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:57.649203 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b729f-2e57-4275-a323-5c6bd446cace None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:57.649483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b729f-2e57-4275-a323-5c6bd446cace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:57.666939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-888b729f-2e57-4275-a323-5c6bd446cace None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:57.668140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-888b729f-2e57-4275-a323-5c6bd446cace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:57.678037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:57.689603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 106/208] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:57.743195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 103/209] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:07:57.892168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e459a3-5a3d-43bf-aca9-a8f4434fc2d7 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:57.892476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e459a3-5a3d-43bf-aca9-a8f4434fc2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:57.892662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e459a3-5a3d-43bf-aca9-a8f4434fc2d7 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:57.894679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 107/210] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:07:57.899838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94817c89-6fa3-4ead-8c51-6ab79f834f1a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:57.900132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94817c89-6fa3-4ead-8c51-6ab79f834f1a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:57.900481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94817c89-6fa3-4ead-8c51-6ab79f834f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:57.918416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-94817c89-6fa3-4ead-8c51-6ab79f834f1a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:07:57.919624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-94817c89-6fa3-4ead-8c51-6ab79f834f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:07:57.954644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e459a3-5a3d-43bf-aca9-a8f4434fc2d7 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:57.989382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 104/211] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:07:58.007994 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94817c89-6fa3-4ead-8c51-6ab79f834f1a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:58.016360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:58.076774 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e459a3-5a3d-43bf-aca9-a8f4434fc2d7 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:58.115565 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3c283-a1b4-49fb-b5fe-d892a3ff3376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:58.116325 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3c283-a1b4-49fb-b5fe-d892a3ff3376 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:58.116511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3c283-a1b4-49fb-b5fe-d892a3ff3376 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:58.116732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3c283-a1b4-49fb-b5fe-d892a3ff3376 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:58.119689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94817c89-6fa3-4ead-8c51-6ab79f834f1a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:58.127411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3c283-a1b4-49fb-b5fe-d892a3ff3376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-2aa3c283-a1b4-49fb-b5fe-d892a3ff3376 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:58.132277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:58.133132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:58.133951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 108/212] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:07:58.140483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3c283-a1b4-49fb-b5fe-d892a3ff3376 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:58.157426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2e16-9143-450f-8e8c-88722abaa471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:58.157989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2e16-9143-450f-8e8c-88722abaa471 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:58.158267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2e16-9143-450f-8e8c-88722abaa471 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:58.158539 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2e16-9143-450f-8e8c-88722abaa471 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:58.160175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b2e16-9143-450f-8e8c-88722abaa471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:58.161616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b2e16-9143-450f-8e8c-88722abaa471 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:58.163346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 105/213] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:07:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:58.169132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2e16-9143-450f-8e8c-88722abaa471 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:58.194648 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:58.244264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3c283-a1b4-49fb-b5fe-d892a3ff3376 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:58.247260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:58.275753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2e16-9143-450f-8e8c-88722abaa471 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:58.280530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af09cc-6dd5-4bb7-8e9c-37c135bde8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:58.281146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af09cc-6dd5-4bb7-8e9c-37c135bde8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:58.281425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af09cc-6dd5-4bb7-8e9c-37c135bde8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:58.281697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af09cc-6dd5-4bb7-8e9c-37c135bde8b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:58.282355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af09cc-6dd5-4bb7-8e9c-37c135bde8b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:58.282658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af09cc-6dd5-4bb7-8e9c-37c135bde8b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:58.284090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af09cc-6dd5-4bb7-8e9c-37c135bde8b8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:58.292073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 109/214] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:58.292856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af09cc-6dd5-4bb7-8e9c-37c135bde8b8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:58.313467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73b486-94a3-4394-9929-ef156c83fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:58.314078 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b486-94a3-4394-9929-ef156c83fb87 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:58.314359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b486-94a3-4394-9929-ef156c83fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:58.314634 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b486-94a3-4394-9929-ef156c83fb87 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:58.315312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73b486-94a3-4394-9929-ef156c83fb87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:58.317477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73b486-94a3-4394-9929-ef156c83fb87 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:58.338829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 106/215] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:07:58 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:07:58.339664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73b486-94a3-4394-9929-ef156c83fb87 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:58.399377 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af09cc-6dd5-4bb7-8e9c-37c135bde8b8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:58.417198 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:58.440206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e76496-3605-4113-8fcb-2646a61ea505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:58.440885 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e76496-3605-4113-8fcb-2646a61ea505 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:58.441164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e76496-3605-4113-8fcb-2646a61ea505 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:58.441440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e76496-3605-4113-8fcb-2646a61ea505 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:58.453170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e76496-3605-4113-8fcb-2646a61ea505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-20e76496-3605-4113-8fcb-2646a61ea505 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:07:58.458717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:07:58.459813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:07:58.460611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 110/216] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:07:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:07:58.467604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e76496-3605-4113-8fcb-2646a61ea505 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:58.486643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73b486-94a3-4394-9929-ef156c83fb87 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:58.520772 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:58.528443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a2dbb-f0a5-45de-a7ba-42ffa9c9ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:58.529091 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a2dbb-f0a5-45de-a7ba-42ffa9c9ddea None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:58.529372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a2dbb-f0a5-45de-a7ba-42ffa9c9ddea None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:58.529654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a2dbb-f0a5-45de-a7ba-42ffa9c9ddea None admin] PATH_INFO: `/v3/users/82614978b0a84737acb1199526e257e4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:58.545156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a2dbb-f0a5-45de-a7ba-42ffa9c9ddea None admin] RBAC: Authorizing `identity:get_user(user_id=82614978b0a84737acb1199526e257e4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:58.546625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a2dbb-f0a5-45de-a7ba-42ffa9c9ddea None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:58.553355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 107/217] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:58 2022] GET /identity/v3/users/82614978b0a84737acb1199526e257e4 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:58.554219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a2dbb-f0a5-45de-a7ba-42ffa9c9ddea None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:58.584371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e76496-3605-4113-8fcb-2646a61ea505 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:58.625121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee9984-4c14-404a-bf00-8d0509f08c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:58.625984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee9984-4c14-404a-bf00-8d0509f08c8d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:58.626383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee9984-4c14-404a-bf00-8d0509f08c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:58.626670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee9984-4c14-404a-bf00-8d0509f08c8d None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:58.627405 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee9984-4c14-404a-bf00-8d0509f08c8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:58.628077 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee9984-4c14-404a-bf00-8d0509f08c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:58.629478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee9984-4c14-404a-bf00-8d0509f08c8d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:58.638421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 111/218] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:07:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:58.645633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee9984-4c14-404a-bf00-8d0509f08c8d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:58.682549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a2dbb-f0a5-45de-a7ba-42ffa9c9ddea None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:58.685814 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:58.725097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1a0b7-a9f4-439e-945f-d2addff403a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:58.725713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1a0b7-a9f4-439e-945f-d2addff403a0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:58.725992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1a0b7-a9f4-439e-945f-d2addff403a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:58.726264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1a0b7-a9f4-439e-945f-d2addff403a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:58.726994 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1a0b7-a9f4-439e-945f-d2addff403a0 None admin] RBAC: Adding query filter params (role.id=d446ff7289fd4718a77384fd80873ca4, user.id=82614978b0a84737acb1199526e257e4, scope.system=all) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:58.727319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1a0b7-a9f4-439e-945f-d2addff403a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:58.729474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1a0b7-a9f4-439e-945f-d2addff403a0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:58.735959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 108/219] 10.222.0.23 () {56 vars in 1308 bytes} [Fri Oct 21 21:07:58 2022] GET /identity/v3/role_assignments?user.id=82614978b0a84737acb1199526e257e4&scope.system=all&role.id=d446ff7289fd4718a77384fd80873ca4 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:58.769623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee9984-4c14-404a-bf00-8d0509f08c8d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:58.810652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c0d66-6232-45b1-8507-be8113cc5fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:58.811715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c0d66-6232-45b1-8507-be8113cc5fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:58.812188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c0d66-6232-45b1-8507-be8113cc5fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:58.812648 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c0d66-6232-45b1-8507-be8113cc5fe1 None admin] PATH_INFO: `/v3/users/ecebe870dd824f4b94f41c62a8b3f584` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:58.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c0d66-6232-45b1-8507-be8113cc5fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=ecebe870dd824f4b94f41c62a8b3f584)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:58.815896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c0d66-6232-45b1-8507-be8113cc5fe1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:58.818179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 112/220] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:07:58 2022] GET /identity/v3/users/ecebe870dd824f4b94f41c62a8b3f584 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:07:58.823964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1a0b7-a9f4-439e-945f-d2addff403a0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:58.887615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:58.942685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1a0b7-a9f4-439e-945f-d2addff403a0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:58.980533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92462-4e68-4fb6-a4ba-81e6f0d3d606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:58.981150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92462-4e68-4fb6-a4ba-81e6f0d3d606 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:58.981429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92462-4e68-4fb6-a4ba-81e6f0d3d606 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:58.981703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92462-4e68-4fb6-a4ba-81e6f0d3d606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:59.051449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c92462-4e68-4fb6-a4ba-81e6f0d3d606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:59.052907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c92462-4e68-4fb6-a4ba-81e6f0d3d606 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:59.109222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:59.158399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 109/221] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:07:59.165042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c0d66-6232-45b1-8507-be8113cc5fe1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:59.273983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c0d66-6232-45b1-8507-be8113cc5fe1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:59.276381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:07:59.310124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad6dfe-ae0a-4564-afd5-15ff0c71f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:59.310758 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad6dfe-ae0a-4564-afd5-15ff0c71f617 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:59.311038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad6dfe-ae0a-4564-afd5-15ff0c71f617 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:59.311333 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad6dfe-ae0a-4564-afd5-15ff0c71f617 None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:59.312457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad6dfe-ae0a-4564-afd5-15ff0c71f617 None admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:59.313899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad6dfe-ae0a-4564-afd5-15ff0c71f617 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:59.316344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 113/222] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:07:59 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:07:59.322488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92462-4e68-4fb6-a4ba-81e6f0d3d606 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:07:59.423853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92462-4e68-4fb6-a4ba-81e6f0d3d606 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:07:59.463447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec6612-de2f-4a99-bf62-2f3821516a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:07:59.464058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec6612-de2f-4a99-bf62-2f3821516a66 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:07:59.464336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec6612-de2f-4a99-bf62-2f3821516a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:07:59.464605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec6612-de2f-4a99-bf62-2f3821516a66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:07:59.465329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec6612-de2f-4a99-bf62-2f3821516a66 None admin] RBAC: Adding query filter params (role.id=a11998246b234a2a9156dcfbd29df373, scope.project.id=8d832454137d4955b3c10426d33bd15a, user.id=ecebe870dd824f4b94f41c62a8b3f584) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:07:59.465632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec6612-de2f-4a99-bf62-2f3821516a66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:07:59.467073 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec6612-de2f-4a99-bf62-2f3821516a66 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:07:59.473005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 110/223] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:07:59 2022] GET /identity/v3/role_assignments?user.id=ecebe870dd824f4b94f41c62a8b3f584&scope.project.id=8d832454137d4955b3c10426d33bd15a&role.id=a11998246b234a2a9156dcfbd29df373 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:00.713546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2952-b396-4e69-b7cb-57dbe1916898 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:00.714100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2952-b396-4e69-b7cb-57dbe1916898 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:00.714100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2952-b396-4e69-b7cb-57dbe1916898 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:00.715611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 114/224] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:00.716646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77750070-f73d-4584-ad04-e8311fb6271d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:00.717011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77750070-f73d-4584-ad04-e8311fb6271d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:00.717198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77750070-f73d-4584-ad04-e8311fb6271d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:00.718635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 111/225] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:08:00.720211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4c423-4426-499e-bd04-59c0da08a74d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:00.720502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4c423-4426-499e-bd04-59c0da08a74d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:00.720785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4c423-4426-499e-bd04-59c0da08a74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:00.723235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be1ecd-f331-4455-bc74-f67b20bb7d97 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:00.723542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be1ecd-f331-4455-bc74-f67b20bb7d97 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:00.723860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be1ecd-f331-4455-bc74-f67b20bb7d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:00.739909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b8f4c423-4426-499e-bd04-59c0da08a74d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:00.741098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b8f4c423-4426-499e-bd04-59c0da08a74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:00.743770 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a1be1ecd-f331-4455-bc74-f67b20bb7d97 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:00.745739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a1be1ecd-f331-4455-bc74-f67b20bb7d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:00.759428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:00.810310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 115/226] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:00.821813 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 112/227] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:08:00.958863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848a1e1-38b9-4ff5-a2c1-c64b8cbdb6ef None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:00.959171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848a1e1-38b9-4ff5-a2c1-c64b8cbdb6ef None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:00.959460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848a1e1-38b9-4ff5-a2c1-c64b8cbdb6ef None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:00.960964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 116/228] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:00.966031 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d373b-d1ae-49a6-869e-6d9b9144b986 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:00.966271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d373b-d1ae-49a6-869e-6d9b9144b986 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:00.966552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d373b-d1ae-49a6-869e-6d9b9144b986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:00.984938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-941d373b-d1ae-49a6-869e-6d9b9144b986 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:00.986116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-941d373b-d1ae-49a6-869e-6d9b9144b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:01.057240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 113/229] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:01.078029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848a1e1-38b9-4ff5-a2c1-c64b8cbdb6ef None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:01.098972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d373b-d1ae-49a6-869e-6d9b9144b986 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:01.181347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:01.187208 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848a1e1-38b9-4ff5-a2c1-c64b8cbdb6ef None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:01.189111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:01.206280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d373b-d1ae-49a6-869e-6d9b9144b986 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:01.225536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22e8b6-3a81-4d1b-8446-441efb9adc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:01.226104 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22e8b6-3a81-4d1b-8446-441efb9adc63 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:01.226380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22e8b6-3a81-4d1b-8446-441efb9adc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:01.226649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22e8b6-3a81-4d1b-8446-441efb9adc63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:01.227792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22e8b6-3a81-4d1b-8446-441efb9adc63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:01.229219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22e8b6-3a81-4d1b-8446-441efb9adc63 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:01.230938 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 117/230] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:01.236097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22e8b6-3a81-4d1b-8446-441efb9adc63 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:01.244531 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a7b84-81e6-4a07-a7c3-6067c03274e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:01.245785 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7b84-81e6-4a07-a7c3-6067c03274e2 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:01.246243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7b84-81e6-4a07-a7c3-6067c03274e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:01.246712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7b84-81e6-4a07-a7c3-6067c03274e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:01.258761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a7b84-81e6-4a07-a7c3-6067c03274e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-1d2a7b84-81e6-4a07-a7c3-6067c03274e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:01.263716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:01.264590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:01.265364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 114/231] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:01.270652 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a7b84-81e6-4a07-a7c3-6067c03274e2 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:01.341900 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22e8b6-3a81-4d1b-8446-441efb9adc63 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:01.373913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a7b84-81e6-4a07-a7c3-6067c03274e2 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:01.375433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606af85c-43a1-4db8-860c-f3676b9b3b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:01.376041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606af85c-43a1-4db8-860c-f3676b9b3b7e None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:01.376322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606af85c-43a1-4db8-860c-f3676b9b3b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:01.376598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606af85c-43a1-4db8-860c-f3676b9b3b7e None admin] PATH_INFO: `/v3/groups` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:01.377256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606af85c-43a1-4db8-860c-f3676b9b3b7e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:01.378713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606af85c-43a1-4db8-860c-f3676b9b3b7e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:01.394122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 118/232] 10.222.0.23 () {60 vars in 1134 bytes} [Fri Oct 21 21:08:01 2022] POST /identity/v3/groups => generated 229 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:08:01.394122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606af85c-43a1-4db8-860c-f3676b9b3b7e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:01.408547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54cb9e-1f8c-4eb4-b622-3bc950e3efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:01.409182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54cb9e-1f8c-4eb4-b622-3bc950e3efc9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:01.410001 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54cb9e-1f8c-4eb4-b622-3bc950e3efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:01.410277 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54cb9e-1f8c-4eb4-b622-3bc950e3efc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:01.410965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54cb9e-1f8c-4eb4-b622-3bc950e3efc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:01.411392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54cb9e-1f8c-4eb4-b622-3bc950e3efc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:01.412970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54cb9e-1f8c-4eb4-b622-3bc950e3efc9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:01.415735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:01.424365 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 115/233] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:08:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:01.430475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54cb9e-1f8c-4eb4-b622-3bc950e3efc9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:01.435724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:01.524487 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606af85c-43a1-4db8-860c-f3676b9b3b7e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:01.546666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54cb9e-1f8c-4eb4-b622-3bc950e3efc9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:01.571006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033b29-368a-46c0-ba45-4265e08fc6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:01.572247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033b29-368a-46c0-ba45-4265e08fc6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:01.572247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033b29-368a-46c0-ba45-4265e08fc6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:01.572247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033b29-368a-46c0-ba45-4265e08fc6b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:01.585421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df033b29-368a-46c0-ba45-4265e08fc6b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:01.586300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693eb96-0530-4bdd-bfd9-8fee66b45af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:01.586930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693eb96-0530-4bdd-bfd9-8fee66b45af6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:01.587207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693eb96-0530-4bdd-bfd9-8fee66b45af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:01.587514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693eb96-0530-4bdd-bfd9-8fee66b45af6 None admin] PATH_INFO: `/v3/users/3837d5167e894cdba7148c6600380c3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-df033b29-368a-46c0-ba45-4265e08fc6b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:01.590852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:01.591750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:01.592571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 119/234] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:01.599308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033b29-368a-46c0-ba45-4265e08fc6b0 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:01.603466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693eb96-0530-4bdd-bfd9-8fee66b45af6 None admin] RBAC: Authorizing `identity:get_user(user_id=3837d5167e894cdba7148c6600380c3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:01.604925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693eb96-0530-4bdd-bfd9-8fee66b45af6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:01.606759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 116/235] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:08:01 2022] GET /identity/v3/users/3837d5167e894cdba7148c6600380c3e => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:01.612264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693eb96-0530-4bdd-bfd9-8fee66b45af6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:01.672980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:01.701307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:01.712961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033b29-368a-46c0-ba45-4265e08fc6b0 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:01.721744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693eb96-0530-4bdd-bfd9-8fee66b45af6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:01.750601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de328123-367c-43e4-899b-1ab13ed62d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:01.751218 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de328123-367c-43e4-899b-1ab13ed62d85 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:01.751543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de328123-367c-43e4-899b-1ab13ed62d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:01.751823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de328123-367c-43e4-899b-1ab13ed62d85 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:01.752489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de328123-367c-43e4-899b-1ab13ed62d85 None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:01.752794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de328123-367c-43e4-899b-1ab13ed62d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:01.754216 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de328123-367c-43e4-899b-1ab13ed62d85 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:01.759995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549eca6-60ac-41ca-9450-6df1f1129e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:01.760598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549eca6-60ac-41ca-9450-6df1f1129e8b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:01.760876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549eca6-60ac-41ca-9450-6df1f1129e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:01.761149 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549eca6-60ac-41ca-9450-6df1f1129e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:01.762007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549eca6-60ac-41ca-9450-6df1f1129e8b None admin] RBAC: Adding query filter params (role.id=a11998246b234a2a9156dcfbd29df373, user.id=3837d5167e894cdba7148c6600380c3e, scope.system=all) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:01.762407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549eca6-60ac-41ca-9450-6df1f1129e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:01.767497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 120/236] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:08:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:01.767636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549eca6-60ac-41ca-9450-6df1f1129e8b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:01.769178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de328123-367c-43e4-899b-1ab13ed62d85 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:01.770037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 117/237] 10.222.0.23 () {56 vars in 1308 bytes} [Fri Oct 21 21:08:01 2022] GET /identity/v3/role_assignments?user.id=3837d5167e894cdba7148c6600380c3e&scope.system=all&role.id=a11998246b234a2a9156dcfbd29df373 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:01.884785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de328123-367c-43e4-899b-1ab13ed62d85 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:01.923464 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2688247-d96e-48f7-adb9-12301c4647e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:01.924483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2688247-d96e-48f7-adb9-12301c4647e7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:01.925009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2688247-d96e-48f7-adb9-12301c4647e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:01.925582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2688247-d96e-48f7-adb9-12301c4647e7 None admin] PATH_INFO: `/v3/users/82614978b0a84737acb1199526e257e4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:01.927002 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2688247-d96e-48f7-adb9-12301c4647e7 None admin] RBAC: Authorizing `identity:get_user(user_id=82614978b0a84737acb1199526e257e4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:01.928759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2688247-d96e-48f7-adb9-12301c4647e7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:01.930633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 121/238] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:08:01 2022] GET /identity/v3/users/82614978b0a84737acb1199526e257e4 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:01.936738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549eca6-60ac-41ca-9450-6df1f1129e8b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:02.040703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549eca6-60ac-41ca-9450-6df1f1129e8b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:02.067569 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:02.083899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ba717-0b34-4e2a-8947-ee36500ee0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:02.084563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ba717-0b34-4e2a-8947-ee36500ee0fb None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:02.084846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ba717-0b34-4e2a-8947-ee36500ee0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:02.085121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ba717-0b34-4e2a-8947-ee36500ee0fb None admin] PATH_INFO: `/v3/system/users/82614978b0a84737acb1199526e257e4/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:02.086534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ba717-0b34-4e2a-8947-ee36500ee0fb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=82614978b0a84737acb1199526e257e4, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:02.087999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ba717-0b34-4e2a-8947-ee36500ee0fb None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:02.098460 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 118/239] 10.222.0.23 () {58 vars in 1334 bytes} [Fri Oct 21 21:08:01 2022] PUT /identity/v3/system/users/82614978b0a84737acb1199526e257e4/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:03.574617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a6d68-136c-42b3-903c-75aab831fd90 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:03.575126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a6d68-136c-42b3-903c-75aab831fd90 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:03.575200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a6d68-136c-42b3-903c-75aab831fd90 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:03.576680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 122/240] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:03.582210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a572af-ecc3-4bbf-9e6a-d51e2ca47092 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:03.582607 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a572af-ecc3-4bbf-9e6a-d51e2ca47092 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:03.582763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a572af-ecc3-4bbf-9e6a-d51e2ca47092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:03.600708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-04a572af-ecc3-4bbf-9e6a-d51e2ca47092 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:03.601881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-04a572af-ecc3-4bbf-9e6a-d51e2ca47092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:03.668498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 119/241] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:03.917991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1aa32-e1c8-4ddd-ae7e-5ff5a2e4b3d0 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:03.918324 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1aa32-e1c8-4ddd-ae7e-5ff5a2e4b3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:03.918549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1aa32-e1c8-4ddd-ae7e-5ff5a2e4b3d0 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:03.919990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 123/242] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:03.925673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d89cd-bc30-444d-9c71-9ba54f4f0436 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:03.925963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d89cd-bc30-444d-9c71-9ba54f4f0436 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:03.926239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d89cd-bc30-444d-9c71-9ba54f4f0436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:03.935827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1aa32-e1c8-4ddd-ae7e-5ff5a2e4b3d0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:03.946222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c69d89cd-bc30-444d-9c71-9ba54f4f0436 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:03.947848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c69d89cd-bc30-444d-9c71-9ba54f4f0436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:03.958540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:04.025055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 120/243] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:04.044040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1aa32-e1c8-4ddd-ae7e-5ff5a2e4b3d0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:04.080138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fe00d-225b-4186-90e9-40543c6c8ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:04.080771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe00d-225b-4186-90e9-40543c6c8ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:04.081052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe00d-225b-4186-90e9-40543c6c8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:04.081327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe00d-225b-4186-90e9-40543c6c8ae6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:04.082423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fe00d-225b-4186-90e9-40543c6c8ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:04.083972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fe00d-225b-4186-90e9-40543c6c8ae6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:04.085741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 124/244] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:04.091025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d89cd-bc30-444d-9c71-9ba54f4f0436 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:04.140733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:04.199464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d89cd-bc30-444d-9c71-9ba54f4f0436 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:04.234059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c31dee-1bd6-42c6-a17c-eefc9542ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:04.234670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31dee-1bd6-42c6-a17c-eefc9542ab96 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:04.234951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31dee-1bd6-42c6-a17c-eefc9542ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:04.235231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31dee-1bd6-42c6-a17c-eefc9542ab96 None admin] PATH_INFO: `/v3/groups` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:04.235941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c31dee-1bd6-42c6-a17c-eefc9542ab96 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:04.237924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c31dee-1bd6-42c6-a17c-eefc9542ab96 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:04.244393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1b42b-ca55-471f-8a00-623ee6120b0f None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:04.244685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1b42b-ca55-471f-8a00-623ee6120b0f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:04.244967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1b42b-ca55-471f-8a00-623ee6120b0f None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:04.246328 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 125/245] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:04.251259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e83f5-b09b-4d7f-ae2b-be7167888d57 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:04.251577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e83f5-b09b-4d7f-ae2b-be7167888d57 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:04.251860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e83f5-b09b-4d7f-ae2b-be7167888d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:04.261323 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 121/246] 10.222.0.23 () {60 vars in 1134 bytes} [Fri Oct 21 21:08:04 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:04.272465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ff4e83f5-b09b-4d7f-ae2b-be7167888d57 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:04.273697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ff4e83f5-b09b-4d7f-ae2b-be7167888d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:04.302441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c31dee-1bd6-42c6-a17c-eefc9542ab96 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:04.352384 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 126/247] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:08:04.414871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c31dee-1bd6-42c6-a17c-eefc9542ab96 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:04.417324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:04.452891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a272972-e632-47e6-960b-de0f562fd5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:04.453441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a272972-e632-47e6-960b-de0f562fd5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:04.453716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a272972-e632-47e6-960b-de0f562fd5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:04.453984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a272972-e632-47e6-960b-de0f562fd5b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:04.464584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a272972-e632-47e6-960b-de0f562fd5b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-7a272972-e632-47e6-960b-de0f562fd5b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:04.470687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:04.471595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:04.472933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 122/248] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:04.478143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e83f5-b09b-4d7f-ae2b-be7167888d57 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:04.498608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:04.587082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e83f5-b09b-4d7f-ae2b-be7167888d57 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:04.622037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154db85-265c-4f57-ae0b-0aced98d8957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:04.622659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154db85-265c-4f57-ae0b-0aced98d8957 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:04.622934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154db85-265c-4f57-ae0b-0aced98d8957 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:04.623217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154db85-265c-4f57-ae0b-0aced98d8957 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:04.623919 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154db85-265c-4f57-ae0b-0aced98d8957 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:04.624233 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154db85-265c-4f57-ae0b-0aced98d8957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:04.625615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154db85-265c-4f57-ae0b-0aced98d8957 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:04.627204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a272972-e632-47e6-960b-de0f562fd5b5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:04.637696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 127/249] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:08:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:04.642947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154db85-265c-4f57-ae0b-0aced98d8957 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:04.744354 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:04.758671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a272972-e632-47e6-960b-de0f562fd5b5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:04.766500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154db85-265c-4f57-ae0b-0aced98d8957 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:04.805005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba268fc-e311-412e-aa30-2063ee3049a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:04.805665 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba268fc-e311-412e-aa30-2063ee3049a7 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:04.805925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba268fc-e311-412e-aa30-2063ee3049a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:04.806199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba268fc-e311-412e-aa30-2063ee3049a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:04.817106 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63798b3-16db-4f10-ade9-a3ae88abccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:04.818086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63798b3-16db-4f10-ade9-a3ae88abccfb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:04.818565 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63798b3-16db-4f10-ade9-a3ae88abccfb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:04.819036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63798b3-16db-4f10-ade9-a3ae88abccfb None admin] PATH_INFO: `/v3/users/3837d5167e894cdba7148c6600380c3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:04.819799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba268fc-e311-412e-aa30-2063ee3049a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:04.820669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63798b3-16db-4f10-ade9-a3ae88abccfb None admin] RBAC: Authorizing `identity:get_user(user_id=3837d5167e894cdba7148c6600380c3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:04.822382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63798b3-16db-4f10-ade9-a3ae88abccfb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:04.824494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 128/250] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:08:04 2022] GET /identity/v3/users/3837d5167e894cdba7148c6600380c3e => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-eba268fc-e311-412e-aa30-2063ee3049a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:04.829780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:04.830682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:04.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 123/251] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:04.834426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba268fc-e311-412e-aa30-2063ee3049a7 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:04.834548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63798b3-16db-4f10-ade9-a3ae88abccfb None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:04.865055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:04.958273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba268fc-e311-412e-aa30-2063ee3049a7 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:04.979465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63798b3-16db-4f10-ade9-a3ae88abccfb None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:05.013245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca180e-9aef-469c-b9e7-35621f97e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:05.013245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca180e-9aef-469c-b9e7-35621f97e193 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:05.013245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca180e-9aef-469c-b9e7-35621f97e193 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:05.013245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca180e-9aef-469c-b9e7-35621f97e193 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:05.013584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca180e-9aef-469c-b9e7-35621f97e193 None admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:05.013757 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca180e-9aef-469c-b9e7-35621f97e193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:05.015111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca180e-9aef-469c-b9e7-35621f97e193 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:05.025193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ff894-a786-4ef2-8f9a-8ea654f1ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:05.026055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff894-a786-4ef2-8f9a-8ea654f1ee10 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:05.026162 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 124/252] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:08:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:05.026585 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff894-a786-4ef2-8f9a-8ea654f1ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:05.026870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff894-a786-4ef2-8f9a-8ea654f1ee10 None admin] PATH_INFO: `/v3/system/users/3837d5167e894cdba7148c6600380c3e/roles/a11998246b234a2a9156dcfbd29df373` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:05.028338 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ff894-a786-4ef2-8f9a-8ea654f1ee10 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3837d5167e894cdba7148c6600380c3e, role_id=a11998246b234a2a9156dcfbd29df373)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:05.029712 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ff894-a786-4ef2-8f9a-8ea654f1ee10 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:05.032208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca180e-9aef-469c-b9e7-35621f97e193 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:05.042592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 129/253] 10.222.0.23 () {58 vars in 1334 bytes} [Fri Oct 21 21:08:04 2022] PUT /identity/v3/system/users/3837d5167e894cdba7148c6600380c3e/roles/a11998246b234a2a9156dcfbd29df373 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:05.137173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:05.157333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca180e-9aef-469c-b9e7-35621f97e193 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:05.198608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e0839-399e-44f2-af2a-8676a8330223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:05.199248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0839-399e-44f2-af2a-8676a8330223 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:05.199556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0839-399e-44f2-af2a-8676a8330223 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:05.199826 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0839-399e-44f2-af2a-8676a8330223 None admin] PATH_INFO: `/v3/users/82614978b0a84737acb1199526e257e4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:05.204174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e0839-399e-44f2-af2a-8676a8330223 None admin] RBAC: Authorizing `identity:get_user(user_id=82614978b0a84737acb1199526e257e4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:05.206033 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e0839-399e-44f2-af2a-8676a8330223 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:05.208764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 125/254] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:08:05 2022] GET /identity/v3/users/82614978b0a84737acb1199526e257e4 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:05.214414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ff894-a786-4ef2-8f9a-8ea654f1ee10 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:05.238921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:05.352162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ff894-a786-4ef2-8f9a-8ea654f1ee10 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:05.391205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7428899-f5d5-4415-a6df-1b3b76f6a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:05.391852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428899-f5d5-4415-a6df-1b3b76f6a73c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:05.392136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428899-f5d5-4415-a6df-1b3b76f6a73c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:05.392416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428899-f5d5-4415-a6df-1b3b76f6a73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:05.393151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7428899-f5d5-4415-a6df-1b3b76f6a73c None admin] RBAC: Adding query filter params (role.id=d446ff7289fd4718a77384fd80873ca4, user.id=82614978b0a84737acb1199526e257e4, scope.system=all) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:05.393522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7428899-f5d5-4415-a6df-1b3b76f6a73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:05.394994 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7428899-f5d5-4415-a6df-1b3b76f6a73c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:05.410577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 130/255] 10.222.0.23 () {56 vars in 1308 bytes} [Fri Oct 21 21:08:05 2022] GET /identity/v3/role_assignments?user.id=82614978b0a84737acb1199526e257e4&scope.system=all&role.id=d446ff7289fd4718a77384fd80873ca4 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:06.678032 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b86c57-ab90-4694-b32a-6221c9668f7e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:06.678531 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b86c57-ab90-4694-b32a-6221c9668f7e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:06.678628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b86c57-ab90-4694-b32a-6221c9668f7e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:06.679989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 126/256] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:06.686941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd3638-3a2f-44eb-9f3a-1a8b64fadd4b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:06.687397 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd3638-3a2f-44eb-9f3a-1a8b64fadd4b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:06.687578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd3638-3a2f-44eb-9f3a-1a8b64fadd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:06.708034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-74dd3638-3a2f-44eb-9f3a-1a8b64fadd4b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:06.709239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-74dd3638-3a2f-44eb-9f3a-1a8b64fadd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:06.785334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 131/257] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 21 21:08:07.345407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b86c57-ab90-4694-b32a-6221c9668f7e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:07.358654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b86c57-ab90-4694-b32a-6221c9668f7e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:07.365614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd52a1-7f2c-4113-912a-26cab11f8be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:07.366272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd52a1-7f2c-4113-912a-26cab11f8be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:07.366563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd52a1-7f2c-4113-912a-26cab11f8be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:07.366841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd52a1-7f2c-4113-912a-26cab11f8be5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:07.379813 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd52a1-7f2c-4113-912a-26cab11f8be5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-64cd52a1-7f2c-4113-912a-26cab11f8be5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:07.384766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:07.386850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:07.388871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 127/258] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 21 21:08:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:07.396849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd3638-3a2f-44eb-9f3a-1a8b64fadd4b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:07.403792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88d95-6798-4304-94ad-ea6a3250c7d2 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:07.404077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88d95-6798-4304-94ad-ea6a3250c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:07.404359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88d95-6798-4304-94ad-ea6a3250c7d2 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:07.405703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 128/259] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:07.409135 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd3638-3a2f-44eb-9f3a-1a8b64fadd4b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:07.411393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb051c6f-19c6-42d6-b286-7c3472d90fa2 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:07.411686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb051c6f-19c6-42d6-b286-7c3472d90fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:07.411963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb051c6f-19c6-42d6-b286-7c3472d90fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:07.418133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5761c0-cfb3-4b21-b800-3a94c473a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:07.418752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5761c0-cfb3-4b21-b800-3a94c473a6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:07.419035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5761c0-cfb3-4b21-b800-3a94c473a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:07.421090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5761c0-cfb3-4b21-b800-3a94c473a6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:07.421799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5761c0-cfb3-4b21-b800-3a94c473a6c2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:07.422113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5761c0-cfb3-4b21-b800-3a94c473a6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:07.423932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-eb5761c0-cfb3-4b21-b800-3a94c473a6c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:08:07.423932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 21 21:08:07.423932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: Oct 21 21:08:07.424884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5761c0-cfb3-4b21-b800-3a94c473a6c2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:07.446111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 132/260] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:08:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:07.452446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5761c0-cfb3-4b21-b800-3a94c473a6c2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:07.459149 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-cb051c6f-19c6-42d6-b286-7c3472d90fa2 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:07.460381 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-cb051c6f-19c6-42d6-b286-7c3472d90fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:07.471085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5761c0-cfb3-4b21-b800-3a94c473a6c2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:07.476088 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3ce15-def3-46a7-87b0-2791728ac7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:07.476739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3ce15-def3-46a7-87b0-2791728ac7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:07.477021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3ce15-def3-46a7-87b0-2791728ac7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:07.477297 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3ce15-def3-46a7-87b0-2791728ac7f4 admin admin] PATH_INFO: `/v3/groups/02a59aa997f24d9b88b2106b0f1a678c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:07.478414 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 129/261] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 21 21:08:07.483918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3ce15-def3-46a7-87b0-2791728ac7f4 admin admin] RBAC: Authorizing `identity:get_group(group_id=02a59aa997f24d9b88b2106b0f1a678c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:07.484953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-16a3ce15-def3-46a7-87b0-2791728ac7f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:08:07.484953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 21 21:08:07.484953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: Oct 21 21:08:07.486171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3ce15-def3-46a7-87b0-2791728ac7f4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:07.488675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 133/262] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Oct 21 21:08:07 2022] GET /identity/v3/groups/02a59aa997f24d9b88b2106b0f1a678c => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:07.488932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:07.496114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb051c6f-19c6-42d6-b286-7c3472d90fa2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:07.505246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb051c6f-19c6-42d6-b286-7c3472d90fa2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:07.516080 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb883f-3646-4bbd-a072-38ef332ec9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:07.516845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb883f-3646-4bbd-a072-38ef332ec9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:07.517201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb883f-3646-4bbd-a072-38ef332ec9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:07.517602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb883f-3646-4bbd-a072-38ef332ec9b1 admin admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:07.524034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb883f-3646-4bbd-a072-38ef332ec9b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:07.526350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb883f-3646-4bbd-a072-38ef332ec9b1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:07.528462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 130/263] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 21 21:08:07 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:07.534402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3ce15-def3-46a7-87b0-2791728ac7f4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:07.549246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3ce15-def3-46a7-87b0-2791728ac7f4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:07.562568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd832fe7-c474-4362-9316-bf1adc330389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:07.563599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd832fe7-c474-4362-9316-bf1adc330389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:07.564078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd832fe7-c474-4362-9316-bf1adc330389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:07.564586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd832fe7-c474-4362-9316-bf1adc330389 admin admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/groups/02a59aa997f24d9b88b2106b0f1a678c/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:07.567298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd832fe7-c474-4362-9316-bf1adc330389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d246b911cdcc47c3831ebcc2ccfa85c4, group_id=02a59aa997f24d9b88b2106b0f1a678c, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:07.568542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-cd832fe7-c474-4362-9316-bf1adc330389 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:08:07.568542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 21 21:08:07.568542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: Oct 21 21:08:07.570859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd832fe7-c474-4362-9316-bf1adc330389 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:07.586287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 134/264] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Oct 21 21:08:07 2022] PUT /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/groups/02a59aa997f24d9b88b2106b0f1a678c/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:08.011731 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb883f-3646-4bbd-a072-38ef332ec9b1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.022311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb883f-3646-4bbd-a072-38ef332ec9b1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:08.103720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dfa34-ef80-4373-986b-c912010ec5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:08.104373 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dfa34-ef80-4373-986b-c912010ec5fe admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.104724 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dfa34-ef80-4373-986b-c912010ec5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.105001 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dfa34-ef80-4373-986b-c912010ec5fe admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.117525 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dfa34-ef80-4373-986b-c912010ec5fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-f74dfa34-ef80-4373-986b-c912010ec5fe admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:08.122574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:08.123479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:08.124282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 131/265] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 21 21:08:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:08.131233 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd832fe7-c474-4362-9316-bf1adc330389 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.142906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd832fe7-c474-4362-9316-bf1adc330389 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:08.151417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a877f-0248-45c9-8800-23fed4d27283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:08.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a877f-0248-45c9-8800-23fed4d27283 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.152316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a877f-0248-45c9-8800-23fed4d27283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.152646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a877f-0248-45c9-8800-23fed4d27283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.153323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a877f-0248-45c9-8800-23fed4d27283 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:08.153628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a877f-0248-45c9-8800-23fed4d27283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:08.155239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a877f-0248-45c9-8800-23fed4d27283 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:08.168347 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 135/266] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Oct 21 21:08:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:08.173983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dfa34-ef80-4373-986b-c912010ec5fe admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.186705 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dfa34-ef80-4373-986b-c912010ec5fe admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:08.194565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbefaf-0b0d-49e0-8885-d63837ba6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:08.195257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbefaf-0b0d-49e0-8885-d63837ba6953 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.195563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbefaf-0b0d-49e0-8885-d63837ba6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.195888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbefaf-0b0d-49e0-8885-d63837ba6953 admin admin] PATH_INFO: `/v3/groups/02a59aa997f24d9b88b2106b0f1a678c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.197026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbefaf-0b0d-49e0-8885-d63837ba6953 admin admin] RBAC: Authorizing `identity:get_group(group_id=02a59aa997f24d9b88b2106b0f1a678c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:08.199112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-34dbefaf-0b0d-49e0-8885-d63837ba6953 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:08:08.199112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 21 21:08:08.199112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: Oct 21 21:08:08.200487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbefaf-0b0d-49e0-8885-d63837ba6953 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:08.202405 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 132/267] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Oct 21 21:08:08 2022] GET /identity/v3/groups/02a59aa997f24d9b88b2106b0f1a678c => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:08.208117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a877f-0248-45c9-8800-23fed4d27283 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.218777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a877f-0248-45c9-8800-23fed4d27283 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:08.220931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79270b-0973-4b50-a0bf-56559cad2a8d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.221270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79270b-0973-4b50-a0bf-56559cad2a8d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.221546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79270b-0973-4b50-a0bf-56559cad2a8d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.224511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 133/268] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:08.231285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2949-dff1-49bf-853f-1469a79f4c01 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.231572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2949-dff1-49bf-853f-1469a79f4c01 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.231852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2949-dff1-49bf-853f-1469a79f4c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.234112 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578b1b4-317b-4de2-8fb3-7b50c964e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:08.234754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578b1b4-317b-4de2-8fb3-7b50c964e981 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.235079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578b1b4-317b-4de2-8fb3-7b50c964e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.235388 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578b1b4-317b-4de2-8fb3-7b50c964e981 admin admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.238499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578b1b4-317b-4de2-8fb3-7b50c964e981 admin admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:08.241510 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578b1b4-317b-4de2-8fb3-7b50c964e981 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:08.244954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 136/269] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 21 21:08:08 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:08.253236 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578b1b4-317b-4de2-8fb3-7b50c964e981 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.273646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578b1b4-317b-4de2-8fb3-7b50c964e981 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:08.275621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-89ef2949-dff1-49bf-853f-1469a79f4c01 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:08.276885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-89ef2949-dff1-49bf-853f-1469a79f4c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:08.283225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccff691-edeb-4034-ac79-cffbbc9b8a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:08.283918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccff691-edeb-4034-ac79-cffbbc9b8a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.285042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccff691-edeb-4034-ac79-cffbbc9b8a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.285328 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccff691-edeb-4034-ac79-cffbbc9b8a57 admin admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/groups/02a59aa997f24d9b88b2106b0f1a678c/roles/d742ebaf9dcb49d38c4758375c5ebd1f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.290524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccff691-edeb-4034-ac79-cffbbc9b8a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d246b911cdcc47c3831ebcc2ccfa85c4, group_id=02a59aa997f24d9b88b2106b0f1a678c, role_id=d742ebaf9dcb49d38c4758375c5ebd1f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:08.294481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 134/270] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 21 21:08:08.295760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d91828-a8d3-4289-920d-5d390b39d63a None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.296102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d91828-a8d3-4289-920d-5d390b39d63a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.296432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d91828-a8d3-4289-920d-5d390b39d63a None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.296601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccff691-edeb-4034-ac79-cffbbc9b8a57 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:08.297744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 135/271] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:08.310817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669037e1-6859-4394-afa9-7f03315e80b9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.311087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669037e1-6859-4394-afa9-7f03315e80b9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.311461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669037e1-6859-4394-afa9-7f03315e80b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.321875 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 137/272] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Oct 21 21:08:08 2022] PUT /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4/groups/02a59aa997f24d9b88b2106b0f1a678c/roles/d742ebaf9dcb49d38c4758375c5ebd1f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:08.342966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-669037e1-6859-4394-afa9-7f03315e80b9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:08.344217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-669037e1-6859-4394-afa9-7f03315e80b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:08.427150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:08.442607 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 136/273] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:08.698536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccff691-edeb-4034-ac79-cffbbc9b8a57 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.769344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccff691-edeb-4034-ac79-cffbbc9b8a57 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:08.776770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9867a-18ad-4d96-ba45-01619e2757df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:08.777415 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9867a-18ad-4d96-ba45-01619e2757df admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.777689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9867a-18ad-4d96-ba45-01619e2757df admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.777960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9867a-18ad-4d96-ba45-01619e2757df admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.789212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9867a-18ad-4d96-ba45-01619e2757df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-59f9867a-18ad-4d96-ba45-01619e2757df admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:08.794071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:08.794934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:08.795775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 138/274] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 21 21:08:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:08.802610 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669037e1-6859-4394-afa9-7f03315e80b9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.813340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669037e1-6859-4394-afa9-7f03315e80b9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:08.823025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e6819-95a2-4e2b-a27a-c8cfeaee9108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:08.823934 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e6819-95a2-4e2b-a27a-c8cfeaee9108 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.824267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e6819-95a2-4e2b-a27a-c8cfeaee9108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.824541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e6819-95a2-4e2b-a27a-c8cfeaee9108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.825265 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e6819-95a2-4e2b-a27a-c8cfeaee9108 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:08.825565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e6819-95a2-4e2b-a27a-c8cfeaee9108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:08.826560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-2b6e6819-95a2-4e2b-a27a-c8cfeaee9108 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:08:08.826560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 21 21:08:08.826560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: Oct 21 21:08:08.827560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e6819-95a2-4e2b-a27a-c8cfeaee9108 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:08.837589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 137/275] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:08:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:08.843399 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9867a-18ad-4d96-ba45-01619e2757df admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.854440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9867a-18ad-4d96-ba45-01619e2757df admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:08.862986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d61b6-577d-4d7e-a7da-e64a6bb8216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:08.863658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d61b6-577d-4d7e-a7da-e64a6bb8216f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.863933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d61b6-577d-4d7e-a7da-e64a6bb8216f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.864261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d61b6-577d-4d7e-a7da-e64a6bb8216f admin admin] PATH_INFO: `/v3/groups/02a59aa997f24d9b88b2106b0f1a678c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.865471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d61b6-577d-4d7e-a7da-e64a6bb8216f admin admin] RBAC: Authorizing `identity:get_group(group_id=02a59aa997f24d9b88b2106b0f1a678c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:08.867487 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d61b6-577d-4d7e-a7da-e64a6bb8216f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:08.869154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 139/276] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Oct 21 21:08:08 2022] GET /identity/v3/groups/02a59aa997f24d9b88b2106b0f1a678c => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:08.874962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e6819-95a2-4e2b-a27a-c8cfeaee9108 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.886798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d61b6-577d-4d7e-a7da-e64a6bb8216f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.887503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e6819-95a2-4e2b-a27a-c8cfeaee9108 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:08.900087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ea2da-fe47-43b4-8c78-764b3df5f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:08.901053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ea2da-fe47-43b4-8c78-764b3df5f9bd admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.901559 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ea2da-fe47-43b4-8c78-764b3df5f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.902034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ea2da-fe47-43b4-8c78-764b3df5f9bd admin admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.904532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ea2da-fe47-43b4-8c78-764b3df5f9bd admin admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:08.906941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ea2da-fe47-43b4-8c78-764b3df5f9bd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:08.909081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 138/277] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 21 21:08:08 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:08.914923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ea2da-fe47-43b4-8c78-764b3df5f9bd admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:08.931548 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ea2da-fe47-43b4-8c78-764b3df5f9bd admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:08.942340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f186f0a-3b65-425c-9ef1-403fd21e5510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:08.943447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f186f0a-3b65-425c-9ef1-403fd21e5510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:08.943956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f186f0a-3b65-425c-9ef1-403fd21e5510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:08.944449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f186f0a-3b65-425c-9ef1-403fd21e5510 admin admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a/groups/02a59aa997f24d9b88b2106b0f1a678c/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:08.946850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f186f0a-3b65-425c-9ef1-403fd21e5510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d832454137d4955b3c10426d33bd15a, group_id=02a59aa997f24d9b88b2106b0f1a678c, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:08.948176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-9f186f0a-3b65-425c-9ef1-403fd21e5510 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:08:08.948176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 21 21:08:08.948176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: Oct 21 21:08:08.950844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f186f0a-3b65-425c-9ef1-403fd21e5510 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:08.977539 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 139/278] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Oct 21 21:08:08 2022] PUT /identity/v3/projects/8d832454137d4955b3c10426d33bd15a/groups/02a59aa997f24d9b88b2106b0f1a678c/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:08:09.006748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:09.017905 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d61b6-577d-4d7e-a7da-e64a6bb8216f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:09.078649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76febed-ab29-4ec6-9ef8-7a2eae9b6ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:09.083624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76febed-ab29-4ec6-9ef8-7a2eae9b6ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:09.083975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76febed-ab29-4ec6-9ef8-7a2eae9b6ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:09.084247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76febed-ab29-4ec6-9ef8-7a2eae9b6ea7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:09.097510 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76febed-ab29-4ec6-9ef8-7a2eae9b6ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b76febed-ab29-4ec6-9ef8-7a2eae9b6ea7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:09.109783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:09.110769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:09.111627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 140/279] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:09.120004 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f186f0a-3b65-425c-9ef1-403fd21e5510 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:09.272484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f186f0a-3b65-425c-9ef1-403fd21e5510 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:09.315085 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416fecf-5c58-4cf1-afa4-8e13d14fdfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:09.316102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416fecf-5c58-4cf1-afa4-8e13d14fdfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:09.316584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416fecf-5c58-4cf1-afa4-8e13d14fdfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:09.317074 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416fecf-5c58-4cf1-afa4-8e13d14fdfc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:09.317937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416fecf-5c58-4cf1-afa4-8e13d14fdfc0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:09.318451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416fecf-5c58-4cf1-afa4-8e13d14fdfc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:09.320034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416fecf-5c58-4cf1-afa4-8e13d14fdfc0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:09.330867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 140/280] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:08:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:09.337405 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76febed-ab29-4ec6-9ef8-7a2eae9b6ea7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:09.368884 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1b76a-c5d4-48b5-85b7-4023e32de957 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:09.369510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1b76a-c5d4-48b5-85b7-4023e32de957 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:09.369985 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1b76a-c5d4-48b5-85b7-4023e32de957 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:09.371867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 141/281] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:09.377351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37c3b-0a4a-4b90-8327-f374e82053be None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:09.378436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37c3b-0a4a-4b90-8327-f374e82053be None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:09.378932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37c3b-0a4a-4b90-8327-f374e82053be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:09.401295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8fd37c3b-0a4a-4b90-8327-f374e82053be None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:09.402894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8fd37c3b-0a4a-4b90-8327-f374e82053be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:09.474640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:09.558488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 142/282] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Oct 21 21:08:09.564627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76febed-ab29-4ec6-9ef8-7a2eae9b6ea7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:09.625941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cef46-8270-4f44-bdde-2ac46ddbd8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:09.626587 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cef46-8270-4f44-bdde-2ac46ddbd8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:09.626869 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cef46-8270-4f44-bdde-2ac46ddbd8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:09.627140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cef46-8270-4f44-bdde-2ac46ddbd8c0 None admin] PATH_INFO: `/v3/users/3837d5167e894cdba7148c6600380c3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:09.629080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cef46-8270-4f44-bdde-2ac46ddbd8c0 None admin] RBAC: Authorizing `identity:get_user(user_id=3837d5167e894cdba7148c6600380c3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:09.630593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cef46-8270-4f44-bdde-2ac46ddbd8c0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:09.632531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 141/283] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:08:09 2022] GET /identity/v3/users/3837d5167e894cdba7148c6600380c3e => generated 293 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:09.638378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd37c3b-0a4a-4b90-8327-f374e82053be None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:09.765345 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd37c3b-0a4a-4b90-8327-f374e82053be None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:09.791250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81095c-41f9-44ae-b7b5-14cd2a954d15 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:09.791901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81095c-41f9-44ae-b7b5-14cd2a954d15 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:09.792376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81095c-41f9-44ae-b7b5-14cd2a954d15 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:09.793911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 142/284] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:09.800700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d152b-98a2-416a-baa3-28954cee1a4c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:09.801221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d152b-98a2-416a-baa3-28954cee1a4c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:09.801717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d152b-98a2-416a-baa3-28954cee1a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:09.811206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188107f5-f6d8-4336-b383-b89264afbaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:09.811775 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188107f5-f6d8-4336-b383-b89264afbaaa None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:09.812050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188107f5-f6d8-4336-b383-b89264afbaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:09.812327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188107f5-f6d8-4336-b383-b89264afbaaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:09.813236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188107f5-f6d8-4336-b383-b89264afbaaa None admin] RBAC: Adding query filter params (role.id=a11998246b234a2a9156dcfbd29df373, user.id=3837d5167e894cdba7148c6600380c3e, scope.system=all) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:09.813542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188107f5-f6d8-4336-b383-b89264afbaaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:09.815078 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188107f5-f6d8-4336-b383-b89264afbaaa None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:09.840183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 143/285] 10.222.0.23 () {56 vars in 1308 bytes} [Fri Oct 21 21:08:09 2022] GET /identity/v3/role_assignments?user.id=3837d5167e894cdba7148c6600380c3e&scope.system=all&role.id=a11998246b234a2a9156dcfbd29df373 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:09.840394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-cd9d152b-98a2-416a-baa3-28954cee1a4c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:09.841824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cd9d152b-98a2-416a-baa3-28954cee1a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:09.858865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 143/286] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 21 21:08:09.927365 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188107f5-f6d8-4336-b383-b89264afbaaa None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:09.945405 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188107f5-f6d8-4336-b383-b89264afbaaa None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:09.950524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9ba90-3b1a-4e7f-b286-436f82200696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:09.951452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ba90-3b1a-4e7f-b286-436f82200696 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:09.951929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ba90-3b1a-4e7f-b286-436f82200696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:09.952458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ba90-3b1a-4e7f-b286-436f82200696 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:09.969714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9ba90-3b1a-4e7f-b286-436f82200696 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-1be9ba90-3b1a-4e7f-b286-436f82200696 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:09.975836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:09.976778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:08:09.977564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:09.980198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 144/287] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 21 21:08:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:09.985786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d152b-98a2-416a-baa3-28954cee1a4c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:10.000398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d152b-98a2-416a-baa3-28954cee1a4c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:10.010382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197827c-34d3-4d7f-994b-001983149bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:10.011016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197827c-34d3-4d7f-994b-001983149bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:10.011341 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197827c-34d3-4d7f-994b-001983149bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:10.011630 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197827c-34d3-4d7f-994b-001983149bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:10.012307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197827c-34d3-4d7f-994b-001983149bf8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:10.012615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197827c-34d3-4d7f-994b-001983149bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:10.014389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197827c-34d3-4d7f-994b-001983149bf8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:10.028441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 144/288] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Oct 21 21:08:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:10.033674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9ba90-3b1a-4e7f-b286-436f82200696 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:10.064590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9ba90-3b1a-4e7f-b286-436f82200696 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:10.075357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f4c73-c678-473e-b8e8-250c3172fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:10.076335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f4c73-c678-473e-b8e8-250c3172fc16 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:10.076806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f4c73-c678-473e-b8e8-250c3172fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:10.077289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f4c73-c678-473e-b8e8-250c3172fc16 admin admin] PATH_INFO: `/v3/groups/02a59aa997f24d9b88b2106b0f1a678c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:10.078626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f4c73-c678-473e-b8e8-250c3172fc16 admin admin] RBAC: Authorizing `identity:get_group(group_id=02a59aa997f24d9b88b2106b0f1a678c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:10.080796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f4c73-c678-473e-b8e8-250c3172fc16 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:10.083009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 145/289] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Oct 21 21:08:10 2022] GET /identity/v3/groups/02a59aa997f24d9b88b2106b0f1a678c => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:10.088286 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197827c-34d3-4d7f-994b-001983149bf8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:10.103017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197827c-34d3-4d7f-994b-001983149bf8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:10.110806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffead1-8bc7-4a8b-ae61-dd7273b0f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:10.111550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffead1-8bc7-4a8b-ae61-dd7273b0f6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:10.111831 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffead1-8bc7-4a8b-ae61-dd7273b0f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:10.112105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffead1-8bc7-4a8b-ae61-dd7273b0f6a4 admin admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:10.115120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffead1-8bc7-4a8b-ae61-dd7273b0f6a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:10.117330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffead1-8bc7-4a8b-ae61-dd7273b0f6a4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:10.119546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 145/290] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 21 21:08:10 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:10.124966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f4c73-c678-473e-b8e8-250c3172fc16 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:10.139514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f4c73-c678-473e-b8e8-250c3172fc16 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:10.147587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fad842-6228-4a3d-9ffb-9757f1e4f935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:10.148624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fad842-6228-4a3d-9ffb-9757f1e4f935 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:10.149114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fad842-6228-4a3d-9ffb-9757f1e4f935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:10.149578 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fad842-6228-4a3d-9ffb-9757f1e4f935 admin admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a/groups/02a59aa997f24d9b88b2106b0f1a678c/roles/d742ebaf9dcb49d38c4758375c5ebd1f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:10.151941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fad842-6228-4a3d-9ffb-9757f1e4f935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d832454137d4955b3c10426d33bd15a, group_id=02a59aa997f24d9b88b2106b0f1a678c, role_id=d742ebaf9dcb49d38c4758375c5ebd1f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:10.154872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fad842-6228-4a3d-9ffb-9757f1e4f935 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:10.175906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 146/291] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Oct 21 21:08:10 2022] PUT /identity/v3/projects/8d832454137d4955b3c10426d33bd15a/groups/02a59aa997f24d9b88b2106b0f1a678c/roles/d742ebaf9dcb49d38c4758375c5ebd1f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:10.296408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffead1-8bc7-4a8b-ae61-dd7273b0f6a4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:10.303624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:10.307838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffead1-8bc7-4a8b-ae61-dd7273b0f6a4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:10.383034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0cdf-2577-4f80-9976-5efe07e3bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:10.383695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0cdf-2577-4f80-9976-5efe07e3bf83 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:10.383952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0cdf-2577-4f80-9976-5efe07e3bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:10.384235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0cdf-2577-4f80-9976-5efe07e3bf83 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:10.402333 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e0cdf-2577-4f80-9976-5efe07e3bf83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-253e0cdf-2577-4f80-9976-5efe07e3bf83 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:10.408082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:10.409015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:10.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 146/292] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 21 21:08:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:10.415161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fad842-6228-4a3d-9ffb-9757f1e4f935 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:10.426241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:10.435403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fad842-6228-4a3d-9ffb-9757f1e4f935 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:10.450759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c874991-e28f-4a30-91af-18447d6cc56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:10.451418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c874991-e28f-4a30-91af-18447d6cc56c admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:10.451694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c874991-e28f-4a30-91af-18447d6cc56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:10.451964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c874991-e28f-4a30-91af-18447d6cc56c admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:10.452638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c874991-e28f-4a30-91af-18447d6cc56c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:10.452937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c874991-e28f-4a30-91af-18447d6cc56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:10.454546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c874991-e28f-4a30-91af-18447d6cc56c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:10.469034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 147/293] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 21 21:08:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:10.474991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0cdf-2577-4f80-9976-5efe07e3bf83 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:10.491380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0cdf-2577-4f80-9976-5efe07e3bf83 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:10.499395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ee59-680a-4058-972b-23146c16b798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:10.500047 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ee59-680a-4058-972b-23146c16b798 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:10.500329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ee59-680a-4058-972b-23146c16b798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:10.500613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ee59-680a-4058-972b-23146c16b798 admin admin] PATH_INFO: `/v3/groups/a33b15fb6a0545c6822e65782e59bdc6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:10.508619 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489ee59-680a-4058-972b-23146c16b798 admin admin] RBAC: Authorizing `identity:get_group(group_id=a33b15fb6a0545c6822e65782e59bdc6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:10.510551 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489ee59-680a-4058-972b-23146c16b798 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:10.512421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 147/294] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Oct 21 21:08:10 2022] GET /identity/v3/groups/a33b15fb6a0545c6822e65782e59bdc6 => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:10.518181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c874991-e28f-4a30-91af-18447d6cc56c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:10.533143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c874991-e28f-4a30-91af-18447d6cc56c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:10.548000 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb91adb-7a88-477d-969b-0995884bca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:10.548687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb91adb-7a88-477d-969b-0995884bca56 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:10.548949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb91adb-7a88-477d-969b-0995884bca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:10.549224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb91adb-7a88-477d-969b-0995884bca56 admin admin] PATH_INFO: `/v3/projects/d513512ae6f8409d87349246d0ba49f1` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:10.550452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb91adb-7a88-477d-969b-0995884bca56 admin admin] RBAC: Authorizing `identity:get_project(project_id=d513512ae6f8409d87349246d0ba49f1)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:10.552501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb91adb-7a88-477d-969b-0995884bca56 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:10.554230 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 148/295] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Oct 21 21:08:10 2022] GET /identity/v3/projects/d513512ae6f8409d87349246d0ba49f1 => generated 344 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:10.560088 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ee59-680a-4058-972b-23146c16b798 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:10.572965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ee59-680a-4058-972b-23146c16b798 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:10.582284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee689ab-55d2-4248-91c6-430ed0c6802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:10.583057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee689ab-55d2-4248-91c6-430ed0c6802a admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:10.583365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee689ab-55d2-4248-91c6-430ed0c6802a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:10.583710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee689ab-55d2-4248-91c6-430ed0c6802a admin admin] PATH_INFO: `/v3/projects/d513512ae6f8409d87349246d0ba49f1/groups/a33b15fb6a0545c6822e65782e59bdc6/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:10.585645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee689ab-55d2-4248-91c6-430ed0c6802a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d513512ae6f8409d87349246d0ba49f1, group_id=a33b15fb6a0545c6822e65782e59bdc6, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:10.588558 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee689ab-55d2-4248-91c6-430ed0c6802a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:10.611999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 148/296] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Oct 21 21:08:10 2022] PUT /identity/v3/projects/d513512ae6f8409d87349246d0ba49f1/groups/a33b15fb6a0545c6822e65782e59bdc6/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:11.078990 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee2bd-07bd-4f2a-9c60-1b91d3ef7953 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:11.079369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee2bd-07bd-4f2a-9c60-1b91d3ef7953 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:11.079572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee2bd-07bd-4f2a-9c60-1b91d3ef7953 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:11.081809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 149/297] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:11.089213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c25a58-83de-4898-a3aa-e1cbc23838dd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:11.089503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c25a58-83de-4898-a3aa-e1cbc23838dd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:11.089783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c25a58-83de-4898-a3aa-e1cbc23838dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:11.109360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d7c25a58-83de-4898-a3aa-e1cbc23838dd None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:11.110526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d7c25a58-83de-4898-a3aa-e1cbc23838dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:11.200068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 149/298] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:11.529293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ee2bd-07bd-4f2a-9c60-1b91d3ef7953 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:11.638949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ee2bd-07bd-4f2a-9c60-1b91d3ef7953 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:11.675290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a795bb-7980-42bc-b62f-73a6b4bd6cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:11.675933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a795bb-7980-42bc-b62f-73a6b4bd6cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:11.676210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a795bb-7980-42bc-b62f-73a6b4bd6cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:11.676474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a795bb-7980-42bc-b62f-73a6b4bd6cd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:11.688431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a795bb-7980-42bc-b62f-73a6b4bd6cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-70a795bb-7980-42bc-b62f-73a6b4bd6cd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:11.694310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:11.695182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:11.696014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:11.699372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 150/299] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:11.702030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c25a58-83de-4898-a3aa-e1cbc23838dd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:11.766217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:11.818632 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c25a58-83de-4898-a3aa-e1cbc23838dd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:11.857100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbd44b-998f-442f-9527-7f72fb4b012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:11.857717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbd44b-998f-442f-9527-7f72fb4b012e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:11.857993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbd44b-998f-442f-9527-7f72fb4b012e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:11.858265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbd44b-998f-442f-9527-7f72fb4b012e None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:11.858925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbd44b-998f-442f-9527-7f72fb4b012e None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:11.859223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbd44b-998f-442f-9527-7f72fb4b012e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:11.860623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbd44b-998f-442f-9527-7f72fb4b012e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:11.874539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 150/300] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:08:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:11.876349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a795bb-7980-42bc-b62f-73a6b4bd6cd4 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:11.932589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:11.986627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a795bb-7980-42bc-b62f-73a6b4bd6cd4 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:12.003640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e3dc4-e9cb-4bb2-97ba-e27b92992df8 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:12.003978 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e3dc4-e9cb-4bb2-97ba-e27b92992df8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:12.004195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e3dc4-e9cb-4bb2-97ba-e27b92992df8 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:12.011427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 151/301] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:12.016964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b52f-4c5f-458f-bd1f-5308dd5030f9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:12.017246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b52f-4c5f-458f-bd1f-5308dd5030f9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:12.017521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b52f-4c5f-458f-bd1f-5308dd5030f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:12.038700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b0a41-5ee8-48fe-82c7-2bfc6fc7e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:12.039400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0a41-5ee8-48fe-82c7-2bfc6fc7e751 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:12.039684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0a41-5ee8-48fe-82c7-2bfc6fc7e751 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:12.040006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0a41-5ee8-48fe-82c7-2bfc6fc7e751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:12.068301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-30a4b52f-4c5f-458f-bd1f-5308dd5030f9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:12.069535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-30a4b52f-4c5f-458f-bd1f-5308dd5030f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:12.122567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b0a41-5ee8-48fe-82c7-2bfc6fc7e751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:12.124192 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b0a41-5ee8-48fe-82c7-2bfc6fc7e751 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:12.182331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:12.203370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 152/302] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:12.204630 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4523-d36e-4172-af18-840d8f9e71ed None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:12.205017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4523-d36e-4172-af18-840d8f9e71ed None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:12.205296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4523-d36e-4172-af18-840d8f9e71ed None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:12.207204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 153/303] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:12.216736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec424216-7108-467c-98e9-81db3c82d974 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:12.217013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec424216-7108-467c-98e9-81db3c82d974 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:12.217287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec424216-7108-467c-98e9-81db3c82d974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:12.240914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 151/304] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:08:12.247404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b0a41-5ee8-48fe-82c7-2bfc6fc7e751 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:12.268436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ec424216-7108-467c-98e9-81db3c82d974 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:12.270192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ec424216-7108-467c-98e9-81db3c82d974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:12.356048 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b0a41-5ee8-48fe-82c7-2bfc6fc7e751 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:12.371247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:12.392979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b7501-80c7-48ba-8e77-a2a7f60064a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:12.394173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b7501-80c7-48ba-8e77-a2a7f60064a0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:12.394463 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b7501-80c7-48ba-8e77-a2a7f60064a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:12.394737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b7501-80c7-48ba-8e77-a2a7f60064a0 None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:12.395906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b7501-80c7-48ba-8e77-a2a7f60064a0 None admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:12.397349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b7501-80c7-48ba-8e77-a2a7f60064a0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:12.403844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 152/305] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:08:12 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:12.404680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b7501-80c7-48ba-8e77-a2a7f60064a0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:12.426791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 154/306] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:12.438304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:12.520264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b7501-80c7-48ba-8e77-a2a7f60064a0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:12.557085 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cace7-a0a2-4b56-997c-abfe11846539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:12.557722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cace7-a0a2-4b56-997c-abfe11846539 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:12.557988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cace7-a0a2-4b56-997c-abfe11846539 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:12.558264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cace7-a0a2-4b56-997c-abfe11846539 None admin] PATH_INFO: `/v3/groups/02a59aa997f24d9b88b2106b0f1a678c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:12.559471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cace7-a0a2-4b56-997c-abfe11846539 None admin] RBAC: Authorizing `identity:get_group(group_id=02a59aa997f24d9b88b2106b0f1a678c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:12.560915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cace7-a0a2-4b56-997c-abfe11846539 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:12.563843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 153/307] 10.222.0.23 () {56 vars in 1180 bytes} [Fri Oct 21 21:08:12 2022] GET /identity/v3/groups/02a59aa997f24d9b88b2106b0f1a678c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:12.569841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec424216-7108-467c-98e9-81db3c82d974 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:12.640593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cace7-a0a2-4b56-997c-abfe11846539 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:12.721406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec424216-7108-467c-98e9-81db3c82d974 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:12.795854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee6450-2a30-4652-8c60-0c5299ca9a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:12.796467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee6450-2a30-4652-8c60-0c5299ca9a31 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:12.796747 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee6450-2a30-4652-8c60-0c5299ca9a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:12.797022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee6450-2a30-4652-8c60-0c5299ca9a31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:12.797753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee6450-2a30-4652-8c60-0c5299ca9a31 None admin] RBAC: Adding query filter params (group.id=02a59aa997f24d9b88b2106b0f1a678c, role.id=d446ff7289fd4718a77384fd80873ca4, scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:12.798058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee6450-2a30-4652-8c60-0c5299ca9a31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:12.799519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee6450-2a30-4652-8c60-0c5299ca9a31 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:12.807646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:12.814500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 155/308] 10.222.0.23 () {56 vars in 1376 bytes} [Fri Oct 21 21:08:12 2022] GET /identity/v3/role_assignments?group.id=02a59aa997f24d9b88b2106b0f1a678c&scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4&role.id=d446ff7289fd4718a77384fd80873ca4 => generated 611 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:12.829523 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee6450-2a30-4652-8c60-0c5299ca9a31 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:12.832423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cace7-a0a2-4b56-997c-abfe11846539 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:12.897896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:12.936723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72d3f2-5860-456b-936b-7639f76a21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:12.937383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72d3f2-5860-456b-936b-7639f76a21b5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:12.937664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72d3f2-5860-456b-936b-7639f76a21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:12.937989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72d3f2-5860-456b-936b-7639f76a21b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:12.964518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee6450-2a30-4652-8c60-0c5299ca9a31 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:12.975956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72d3f2-5860-456b-936b-7639f76a21b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-8a72d3f2-5860-456b-936b-7639f76a21b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:12.981103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:12.981978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:12.982752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 154/309] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:08:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:12.983930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766fe9c-4112-491b-8746-d615727d2b9f None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:12.984087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766fe9c-4112-491b-8746-d615727d2b9f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:12.987328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766fe9c-4112-491b-8746-d615727d2b9f None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:12.987328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 155/310] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:12.992372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766fe9c-4112-491b-8746-d615727d2b9f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:13.017320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091503b-dccb-468a-826f-995a08528872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:13.018080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091503b-dccb-468a-826f-995a08528872 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:13.018366 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091503b-dccb-468a-826f-995a08528872 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:13.019187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091503b-dccb-468a-826f-995a08528872 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:13.035251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091503b-dccb-468a-826f-995a08528872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-e091503b-dccb-468a-826f-995a08528872 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:13.042673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:13.043622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 21 21:08:13.044500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:13.045090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 156/311] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:13.047339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fd1f6-242e-4c26-9fe2-e20d83674c65 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:13.047339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fd1f6-242e-4c26-9fe2-e20d83674c65 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:13.047339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fd1f6-242e-4c26-9fe2-e20d83674c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:13.084704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a19fd1f6-242e-4c26-9fe2-e20d83674c65 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:13.085922 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a19fd1f6-242e-4c26-9fe2-e20d83674c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:13.158598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766fe9c-4112-491b-8746-d615727d2b9f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:13.176948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 157/312] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:13.177732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fd1f6-242e-4c26-9fe2-e20d83674c65 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:13.221383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96b418-9adc-42aa-87e9-7f5dd9b32eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:13.222245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:13.223780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96b418-9adc-42aa-87e9-7f5dd9b32eda None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:13.224152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96b418-9adc-42aa-87e9-7f5dd9b32eda None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:13.224600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96b418-9adc-42aa-87e9-7f5dd9b32eda None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:13.225576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96b418-9adc-42aa-87e9-7f5dd9b32eda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:13.227819 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96b418-9adc-42aa-87e9-7f5dd9b32eda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:13.230278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96b418-9adc-42aa-87e9-7f5dd9b32eda None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:13.241451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 156/313] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:13.247140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96b418-9adc-42aa-87e9-7f5dd9b32eda None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:13.261163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:13.316850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fd1f6-242e-4c26-9fe2-e20d83674c65 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:13.365407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270776dd-6f28-4927-ab07-c2948e60bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:13.366028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270776dd-6f28-4927-ab07-c2948e60bea9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:13.366600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270776dd-6f28-4927-ab07-c2948e60bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:13.366878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270776dd-6f28-4927-ab07-c2948e60bea9 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:13.367578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270776dd-6f28-4927-ab07-c2948e60bea9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:13.367883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270776dd-6f28-4927-ab07-c2948e60bea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:13.369917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270776dd-6f28-4927-ab07-c2948e60bea9 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:13.378626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96b418-9adc-42aa-87e9-7f5dd9b32eda None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:13.382601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 158/314] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:08:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:13.389459 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270776dd-6f28-4927-ab07-c2948e60bea9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:13.429956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9700915-2d88-48ee-b6d8-7dc3a3f270e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:13.430573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9700915-2d88-48ee-b6d8-7dc3a3f270e5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:13.430857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9700915-2d88-48ee-b6d8-7dc3a3f270e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:13.431133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9700915-2d88-48ee-b6d8-7dc3a3f270e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:13.521233 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:13.525432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9700915-2d88-48ee-b6d8-7dc3a3f270e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:13.526885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9700915-2d88-48ee-b6d8-7dc3a3f270e5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:13.537602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:13.539146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270776dd-6f28-4927-ab07-c2948e60bea9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:13.588225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6b200-2ac3-4135-976b-18ac9b1d5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:13.588842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6b200-2ac3-4135-976b-18ac9b1d5d3e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:13.589118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6b200-2ac3-4135-976b-18ac9b1d5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:13.589395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6b200-2ac3-4135-976b-18ac9b1d5d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:13.667364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 157/315] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 21 21:08:13.668448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9700915-2d88-48ee-b6d8-7dc3a3f270e5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:13.687818 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6b200-2ac3-4135-976b-18ac9b1d5d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:13.688855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6b200-2ac3-4135-976b-18ac9b1d5d3e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:13.798163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:13.800636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9700915-2d88-48ee-b6d8-7dc3a3f270e5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:13.808983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 159/316] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 21 21:08:13.809651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6b200-2ac3-4135-976b-18ac9b1d5d3e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:13.811750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:13.843177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45364b9-9714-4747-819d-a6e3a2704670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:13.843826 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45364b9-9714-4747-819d-a6e3a2704670 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:13.844100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45364b9-9714-4747-819d-a6e3a2704670 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:13.844366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45364b9-9714-4747-819d-a6e3a2704670 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:13.859625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45364b9-9714-4747-819d-a6e3a2704670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-a45364b9-9714-4747-819d-a6e3a2704670 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:13.864799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:13.865669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:13.866984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 158/317] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:08:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:13.867672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535b623-056f-4559-9d8f-8039ed761a74 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:13.867672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535b623-056f-4559-9d8f-8039ed761a74 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:13.867672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535b623-056f-4559-9d8f-8039ed761a74 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:13.869533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 159/318] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:13.870082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535b623-056f-4559-9d8f-8039ed761a74 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:13.926565 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6b200-2ac3-4135-976b-18ac9b1d5d3e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:13.966392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df1799-a18e-4e39-a017-385e6b89f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:13.966948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df1799-a18e-4e39-a017-385e6b89f4fe None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:13.967224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df1799-a18e-4e39-a017-385e6b89f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:13.968188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df1799-a18e-4e39-a017-385e6b89f4fe None admin] PATH_INFO: `/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:13.969387 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df1799-a18e-4e39-a017-385e6b89f4fe None admin] RBAC: Authorizing `identity:get_project(project_id=d246b911cdcc47c3831ebcc2ccfa85c4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:13.970815 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df1799-a18e-4e39-a017-385e6b89f4fe None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:13.972801 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 160/319] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:08:13 2022] GET /identity/v3/projects/d246b911cdcc47c3831ebcc2ccfa85c4 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:13.973856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb3fb-4fef-40cc-b42a-87141ea13f89 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:13.974247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb3fb-4fef-40cc-b42a-87141ea13f89 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:13.974529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb3fb-4fef-40cc-b42a-87141ea13f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:13.988525 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535b623-056f-4559-9d8f-8039ed761a74 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:13.993242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b7dcb3fb-4fef-40cc-b42a-87141ea13f89 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:13.994429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b7dcb3fb-4fef-40cc-b42a-87141ea13f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:14.029224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01bcc-cb1f-493a-86f2-da18a2b71064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:14.030311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01bcc-cb1f-493a-86f2-da18a2b71064 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:14.030903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01bcc-cb1f-493a-86f2-da18a2b71064 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:14.031336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01bcc-cb1f-493a-86f2-da18a2b71064 None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:14.033050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01bcc-cb1f-493a-86f2-da18a2b71064 None admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:14.034659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01bcc-cb1f-493a-86f2-da18a2b71064 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:14.036684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 160/320] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:08:13 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:14.038091 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01bcc-cb1f-493a-86f2-da18a2b71064 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:14.066845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:14.079821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 161/321] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:14.080749 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb3fb-4fef-40cc-b42a-87141ea13f89 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:14.083680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:14.169905 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01bcc-cb1f-493a-86f2-da18a2b71064 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:14.204774 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb3fb-4fef-40cc-b42a-87141ea13f89 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:14.221377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e6509-fdbd-44fd-bec4-472c5d5e017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:14.224221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e6509-fdbd-44fd-bec4-472c5d5e017d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:14.224221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e6509-fdbd-44fd-bec4-472c5d5e017d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:14.224221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e6509-fdbd-44fd-bec4-472c5d5e017d None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:14.224553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e6509-fdbd-44fd-bec4-472c5d5e017d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:14.224845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e6509-fdbd-44fd-bec4-472c5d5e017d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:14.226891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e6509-fdbd-44fd-bec4-472c5d5e017d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:14.239161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 161/322] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:14.243517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d474-e867-40e0-90e3-1e39b649e1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:14.244326 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d474-e867-40e0-90e3-1e39b649e1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:14.244589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e6509-fdbd-44fd-bec4-472c5d5e017d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:14.244713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d474-e867-40e0-90e3-1e39b649e1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:14.244884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d474-e867-40e0-90e3-1e39b649e1f6 None admin] PATH_INFO: `/v3/groups/02a59aa997f24d9b88b2106b0f1a678c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:14.245957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827d474-e867-40e0-90e3-1e39b649e1f6 None admin] RBAC: Authorizing `identity:get_group(group_id=02a59aa997f24d9b88b2106b0f1a678c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:14.247923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827d474-e867-40e0-90e3-1e39b649e1f6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:14.248998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 162/323] 10.222.0.23 () {56 vars in 1180 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/groups/02a59aa997f24d9b88b2106b0f1a678c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:14.249766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d474-e867-40e0-90e3-1e39b649e1f6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:14.314381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:14.364590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d474-e867-40e0-90e3-1e39b649e1f6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:14.380307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:14.384544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e6509-fdbd-44fd-bec4-472c5d5e017d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:14.407396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0752a3e-10d0-4a91-baff-3348a3167041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:14.408016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0752a3e-10d0-4a91-baff-3348a3167041 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:14.408297 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0752a3e-10d0-4a91-baff-3348a3167041 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:14.408570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0752a3e-10d0-4a91-baff-3348a3167041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:14.425503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1deb-ea4f-403a-849a-444abdfd53bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:14.426143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1deb-ea4f-403a-849a-444abdfd53bb None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:14.426424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1deb-ea4f-403a-849a-444abdfd53bb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:14.426693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1deb-ea4f-403a-849a-444abdfd53bb None admin] PATH_INFO: `/v3/groups/02a59aa997f24d9b88b2106b0f1a678c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:14.428213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e1deb-ea4f-403a-849a-444abdfd53bb None admin] RBAC: Authorizing `identity:get_group(group_id=02a59aa997f24d9b88b2106b0f1a678c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:14.429637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e1deb-ea4f-403a-849a-444abdfd53bb None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:14.431195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 162/324] 10.222.0.23 () {56 vars in 1180 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/groups/02a59aa997f24d9b88b2106b0f1a678c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:14.432110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1deb-ea4f-403a-849a-444abdfd53bb None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:14.486844 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0752a3e-10d0-4a91-baff-3348a3167041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:14.488787 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0752a3e-10d0-4a91-baff-3348a3167041 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:14.535409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1deb-ea4f-403a-849a-444abdfd53bb None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:14.544297 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:14.569204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9bba8-bd1e-462e-b7b4-307ec175bec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:14.569809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9bba8-bd1e-462e-b7b4-307ec175bec1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:14.570087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9bba8-bd1e-462e-b7b4-307ec175bec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:14.570360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9bba8-bd1e-462e-b7b4-307ec175bec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:14.571081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9bba8-bd1e-462e-b7b4-307ec175bec1 None admin] RBAC: Adding query filter params (group.id=02a59aa997f24d9b88b2106b0f1a678c, role.id=d742ebaf9dcb49d38c4758375c5ebd1f, scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:14.571421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9bba8-bd1e-462e-b7b4-307ec175bec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:14.572836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9bba8-bd1e-462e-b7b4-307ec175bec1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:14.578700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 163/325] 10.222.0.23 () {56 vars in 1376 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/role_assignments?group.id=02a59aa997f24d9b88b2106b0f1a678c&scope.project.id=d246b911cdcc47c3831ebcc2ccfa85c4&role.id=d742ebaf9dcb49d38c4758375c5ebd1f => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:14.579502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9bba8-bd1e-462e-b7b4-307ec175bec1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:14.593631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 163/326] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:08:14.593631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0752a3e-10d0-4a91-baff-3348a3167041 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:14.616579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:14.698630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9bba8-bd1e-462e-b7b4-307ec175bec1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:14.711042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0752a3e-10d0-4a91-baff-3348a3167041 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:14.735856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2734653-dff4-4aa6-a7a6-7470d5fede8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:14.736502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2734653-dff4-4aa6-a7a6-7470d5fede8f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:14.736782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2734653-dff4-4aa6-a7a6-7470d5fede8f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:14.737115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2734653-dff4-4aa6-a7a6-7470d5fede8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:14.748680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2734653-dff4-4aa6-a7a6-7470d5fede8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:14.749430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601024-5f6c-42aa-ad9e-6cb88ff054a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:14.750243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601024-5f6c-42aa-ad9e-6cb88ff054a2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:14.750517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601024-5f6c-42aa-ad9e-6cb88ff054a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:14.750782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601024-5f6c-42aa-ad9e-6cb88ff054a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:14.751540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd601024-5f6c-42aa-ad9e-6cb88ff054a2 None admin] RBAC: Adding query filter params (group.id=02a59aa997f24d9b88b2106b0f1a678c, role.id=d446ff7289fd4718a77384fd80873ca4, scope.project.id=8d832454137d4955b3c10426d33bd15a) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:14.751843 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd601024-5f6c-42aa-ad9e-6cb88ff054a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:14.753810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd601024-5f6c-42aa-ad9e-6cb88ff054a2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-b2734653-dff4-4aa6-a7a6-7470d5fede8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:14.754588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:14.755494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:14.756271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 164/327] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:14.756914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2734653-dff4-4aa6-a7a6-7470d5fede8f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:14.767863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 164/328] 10.222.0.23 () {56 vars in 1376 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/role_assignments?group.id=02a59aa997f24d9b88b2106b0f1a678c&scope.project.id=8d832454137d4955b3c10426d33bd15a&role.id=d446ff7289fd4718a77384fd80873ca4 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:14.767863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601024-5f6c-42aa-ad9e-6cb88ff054a2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:14.804812 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:14.890898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:14.906496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2734653-dff4-4aa6-a7a6-7470d5fede8f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:14.907438 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601024-5f6c-42aa-ad9e-6cb88ff054a2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:14.954935 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa480e84-a78c-46a0-8cb8-5cb992702267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:14.956085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480e84-a78c-46a0-8cb8-5cb992702267 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:14.957109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480e84-a78c-46a0-8cb8-5cb992702267 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:14.957571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480e84-a78c-46a0-8cb8-5cb992702267 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:14.958246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa480e84-a78c-46a0-8cb8-5cb992702267 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:14.958552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa480e84-a78c-46a0-8cb8-5cb992702267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:14.959971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa480e84-a78c-46a0-8cb8-5cb992702267 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:14.961600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81a4bf-ff73-4da9-af2a-d5a5d705dd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:14.962550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a4bf-ff73-4da9-af2a-d5a5d705dd8b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:14.962999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a4bf-ff73-4da9-af2a-d5a5d705dd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:14.963482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a4bf-ff73-4da9-af2a-d5a5d705dd8b None admin] PATH_INFO: `/v3/projects/8d832454137d4955b3c10426d33bd15a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:14.965707 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81a4bf-ff73-4da9-af2a-d5a5d705dd8b None admin] RBAC: Authorizing `identity:get_project(project_id=8d832454137d4955b3c10426d33bd15a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:14.967491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81a4bf-ff73-4da9-af2a-d5a5d705dd8b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:14.969191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 165/329] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:14.971356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 165/330] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/projects/8d832454137d4955b3c10426d33bd15a => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:14.975079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa480e84-a78c-46a0-8cb8-5cb992702267 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:14.976305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81a4bf-ff73-4da9-af2a-d5a5d705dd8b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:15.086594 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:15.106672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa480e84-a78c-46a0-8cb8-5cb992702267 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:15.116049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81a4bf-ff73-4da9-af2a-d5a5d705dd8b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:15.149849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e513-5616-4c66-ba21-fe79a55577c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:15.150465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e513-5616-4c66-ba21-fe79a55577c8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:15.150767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e513-5616-4c66-ba21-fe79a55577c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:15.151028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e513-5616-4c66-ba21-fe79a55577c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:15.155439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56fb9a-6047-4fa0-bdc0-1a78ebbdfc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:15.156067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56fb9a-6047-4fa0-bdc0-1a78ebbdfc0b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:15.156347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56fb9a-6047-4fa0-bdc0-1a78ebbdfc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:15.156621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56fb9a-6047-4fa0-bdc0-1a78ebbdfc0b None admin] PATH_INFO: `/v3/groups/02a59aa997f24d9b88b2106b0f1a678c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:15.157759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56fb9a-6047-4fa0-bdc0-1a78ebbdfc0b None admin] RBAC: Authorizing `identity:get_group(group_id=02a59aa997f24d9b88b2106b0f1a678c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:15.159783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56fb9a-6047-4fa0-bdc0-1a78ebbdfc0b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:15.161683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 166/331] 10.222.0.23 () {56 vars in 1180 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/groups/02a59aa997f24d9b88b2106b0f1a678c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:15.167549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56fb9a-6047-4fa0-bdc0-1a78ebbdfc0b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:15.203699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:15.229633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e513-5616-4c66-ba21-fe79a55577c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:15.231078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e513-5616-4c66-ba21-fe79a55577c8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:15.279998 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56fb9a-6047-4fa0-bdc0-1a78ebbdfc0b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:15.312512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386cbfe-5338-478b-a39b-64c38002bdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:15.312778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:15.313047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386cbfe-5338-478b-a39b-64c38002bdae None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:15.313681 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386cbfe-5338-478b-a39b-64c38002bdae None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:15.314082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386cbfe-5338-478b-a39b-64c38002bdae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:15.315047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386cbfe-5338-478b-a39b-64c38002bdae None admin] RBAC: Adding query filter params (group.id=02a59aa997f24d9b88b2106b0f1a678c, role.id=d742ebaf9dcb49d38c4758375c5ebd1f, scope.project.id=8d832454137d4955b3c10426d33bd15a) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:15.315963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386cbfe-5338-478b-a39b-64c38002bdae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:15.317376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386cbfe-5338-478b-a39b-64c38002bdae None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:15.322995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 167/332] 10.222.0.23 () {56 vars in 1376 bytes} [Fri Oct 21 21:08:15 2022] GET /identity/v3/role_assignments?group.id=02a59aa997f24d9b88b2106b0f1a678c&scope.project.id=8d832454137d4955b3c10426d33bd15a&role.id=d742ebaf9dcb49d38c4758375c5ebd1f => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:15.329755 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 166/333] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:08:15.335733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386cbfe-5338-478b-a39b-64c38002bdae None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:15.431297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:15.441956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386cbfe-5338-478b-a39b-64c38002bdae None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:15.477674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784eb55-737d-43ac-84ed-4a4b9d80ea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:15.478315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784eb55-737d-43ac-84ed-4a4b9d80ea4e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:15.478595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784eb55-737d-43ac-84ed-4a4b9d80ea4e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:15.478871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784eb55-737d-43ac-84ed-4a4b9d80ea4e None admin] PATH_INFO: `/v3/projects/d513512ae6f8409d87349246d0ba49f1` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:15.480016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784eb55-737d-43ac-84ed-4a4b9d80ea4e None admin] RBAC: Authorizing `identity:get_project(project_id=d513512ae6f8409d87349246d0ba49f1)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:15.481451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784eb55-737d-43ac-84ed-4a4b9d80ea4e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:15.483089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 168/334] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:08:15 2022] GET /identity/v3/projects/d513512ae6f8409d87349246d0ba49f1 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:15.490586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e513-5616-4c66-ba21-fe79a55577c8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:15.591722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e513-5616-4c66-ba21-fe79a55577c8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:15.627408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be296ba-8449-4c39-8c77-1f5cd67e3e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:15.628071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be296ba-8449-4c39-8c77-1f5cd67e3e79 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:15.628352 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be296ba-8449-4c39-8c77-1f5cd67e3e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:15.628621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be296ba-8449-4c39-8c77-1f5cd67e3e79 None admin] PATH_INFO: `/v3/groups/a33b15fb6a0545c6822e65782e59bdc6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:15.629714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be296ba-8449-4c39-8c77-1f5cd67e3e79 None admin] RBAC: Authorizing `identity:get_group(group_id=a33b15fb6a0545c6822e65782e59bdc6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:15.631138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be296ba-8449-4c39-8c77-1f5cd67e3e79 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:15.632731 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 167/335] 10.222.0.23 () {56 vars in 1180 bytes} [Fri Oct 21 21:08:15 2022] GET /identity/v3/groups/a33b15fb6a0545c6822e65782e59bdc6 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:15.638608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784eb55-737d-43ac-84ed-4a4b9d80ea4e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:15.740082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784eb55-737d-43ac-84ed-4a4b9d80ea4e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:15.771969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0feaf-43e9-4ab3-ae39-a97ad3712829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:15.772566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0feaf-43e9-4ab3-ae39-a97ad3712829 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:15.772847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0feaf-43e9-4ab3-ae39-a97ad3712829 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:15.773122 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0feaf-43e9-4ab3-ae39-a97ad3712829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:15.773841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0feaf-43e9-4ab3-ae39-a97ad3712829 None admin] RBAC: Adding query filter params (group.id=a33b15fb6a0545c6822e65782e59bdc6, role.id=58b61e8083c64fd58b3eb63efc4c7e3e, scope.project.id=d513512ae6f8409d87349246d0ba49f1) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:15.774149 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0feaf-43e9-4ab3-ae39-a97ad3712829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:15.775590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0feaf-43e9-4ab3-ae39-a97ad3712829 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:15.781075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 169/336] 10.222.0.23 () {56 vars in 1376 bytes} [Fri Oct 21 21:08:15 2022] GET /identity/v3/role_assignments?group.id=a33b15fb6a0545c6822e65782e59bdc6&scope.project.id=d513512ae6f8409d87349246d0ba49f1&role.id=58b61e8083c64fd58b3eb63efc4c7e3e => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:18.241843 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f7e1-61e6-4db9-b78c-5338284f9290 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:18.242402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f7e1-61e6-4db9-b78c-5338284f9290 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:18.242402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f7e1-61e6-4db9-b78c-5338284f9290 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:18.243977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 168/337] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:18.249386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518611c-3cd8-4203-84c6-2f2791952c9e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:18.249833 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518611c-3cd8-4203-84c6-2f2791952c9e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:18.249916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518611c-3cd8-4203-84c6-2f2791952c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:18.271140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a518611c-3cd8-4203-84c6-2f2791952c9e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:18.272380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a518611c-3cd8-4203-84c6-2f2791952c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:18.293485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:18.369252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 170/338] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:08:18.431607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b15a61-bc06-47c6-9624-f447082cba81 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:18.431926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b15a61-bc06-47c6-9624-f447082cba81 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:18.432155 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b15a61-bc06-47c6-9624-f447082cba81 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:18.433738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 169/339] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:18.444853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19975b99-d0eb-420f-84d1-33f58292f28e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:18.445405 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19975b99-d0eb-420f-84d1-33f58292f28e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:18.445882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19975b99-d0eb-420f-84d1-33f58292f28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:18.472030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-19975b99-d0eb-420f-84d1-33f58292f28e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:18.473554 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-19975b99-d0eb-420f-84d1-33f58292f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:18.570020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 171/340] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:18.664470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b15a61-bc06-47c6-9624-f447082cba81 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:18.736824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:18.806523 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b15a61-bc06-47c6-9624-f447082cba81 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:18.853282 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee8ebe-8780-474f-a20b-d1efcc57aa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:18.853941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8ebe-8780-474f-a20b-d1efcc57aa46 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:18.854221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8ebe-8780-474f-a20b-d1efcc57aa46 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:18.854495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8ebe-8780-474f-a20b-d1efcc57aa46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:18.871558 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee8ebe-8780-474f-a20b-d1efcc57aa46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:18.873032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee8ebe-8780-474f-a20b-d1efcc57aa46 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-dbee8ebe-8780-474f-a20b-d1efcc57aa46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:18.895842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:18.896845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:18.898083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:18.898083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:18.898083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:18.898544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19975b99-d0eb-420f-84d1-33f58292f28e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:18.898624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 170/341] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:18.905995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee8ebe-8780-474f-a20b-d1efcc57aa46 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:19.039912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:19.065355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19975b99-d0eb-420f-84d1-33f58292f28e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:19.076446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee8ebe-8780-474f-a20b-d1efcc57aa46 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:19.078842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:19.108273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbab1b-78f2-4fb6-9389-3c3b355e58de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:19.109010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbab1b-78f2-4fb6-9389-3c3b355e58de None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:19.109302 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbab1b-78f2-4fb6-9389-3c3b355e58de None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:19.109656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbab1b-78f2-4fb6-9389-3c3b355e58de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:19.111047 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f580b-1b14-4426-88b6-cbcad3c9d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:19.111674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f580b-1b14-4426-88b6-cbcad3c9d889 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:19.111952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f580b-1b14-4426-88b6-cbcad3c9d889 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:19.112787 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f580b-1b14-4426-88b6-cbcad3c9d889 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:19.113424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f580b-1b14-4426-88b6-cbcad3c9d889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:19.113726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f580b-1b14-4426-88b6-cbcad3c9d889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:19.115078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f580b-1b14-4426-88b6-cbcad3c9d889 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:19.120963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbab1b-78f2-4fb6-9389-3c3b355e58de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:19.122426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbab1b-78f2-4fb6-9389-3c3b355e58de None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:19.132187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 171/342] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:19.137762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313e33-721f-4c93-83d0-a22bc598e7f3 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:19.138044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313e33-721f-4c93-83d0-a22bc598e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:19.138312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313e33-721f-4c93-83d0-a22bc598e7f3 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-b7bbab1b-78f2-4fb6-9389-3c3b355e58de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:19.138526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:19.139399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:19.140616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:19.140616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:19.140616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:19.141053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 172/343] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:19.141053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ef7a-4f8b-4ceb-9959-d8d31cbee93c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:19.141189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ef7a-4f8b-4ceb-9959-d8d31cbee93c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:19.141406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ef7a-4f8b-4ceb-9959-d8d31cbee93c None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:19.147081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 173/344] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:19.147081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ef7a-4f8b-4ceb-9959-d8d31cbee93c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:19.147311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 172/345] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:19.147311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a098-da31-439e-b858-3e22f7716a18 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:19.147311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a098-da31-439e-b858-3e22f7716a18 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:19.147311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a098-da31-439e-b858-3e22f7716a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:19.165626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-97a1a098-da31-439e-b858-3e22f7716a18 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:19.166822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-97a1a098-da31-439e-b858-3e22f7716a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:19.236487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 173/346] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:19.244805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e22e-46b4-4854-9123-4523802d607f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:19.245087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e22e-46b4-4854-9123-4523802d607f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:19.245375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e22e-46b4-4854-9123-4523802d607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:19.256511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ef7a-4f8b-4ceb-9959-d8d31cbee93c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:19.265885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-bd32e22e-46b4-4854-9123-4523802d607f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:19.267652 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bd32e22e-46b4-4854-9123-4523802d607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:19.295794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1b546-17bb-42d4-b66c-e1c4be1bc476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:19.296887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1b546-17bb-42d4-b66c-e1c4be1bc476 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:19.297370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1b546-17bb-42d4-b66c-e1c4be1bc476 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:19.297879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1b546-17bb-42d4-b66c-e1c4be1bc476 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:19.298782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1b546-17bb-42d4-b66c-e1c4be1bc476 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:19.301320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1b546-17bb-42d4-b66c-e1c4be1bc476 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:19.331860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 174/347] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:08:19 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:19.333171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1b546-17bb-42d4-b66c-e1c4be1bc476 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:19.337346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:19.351862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 174/348] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:19.378679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:19.507395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1b546-17bb-42d4-b66c-e1c4be1bc476 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:19.561148 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25c998-e2da-4c36-88e5-3cf614b917b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:19.561786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c998-e2da-4c36-88e5-3cf614b917b9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:19.562076 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c998-e2da-4c36-88e5-3cf614b917b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:19.562353 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25c998-e2da-4c36-88e5-3cf614b917b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:19.563008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25c998-e2da-4c36-88e5-3cf614b917b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:19.563344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25c998-e2da-4c36-88e5-3cf614b917b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:19.564738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25c998-e2da-4c36-88e5-3cf614b917b9 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:19.577888 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 175/349] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:19.584040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e22e-46b4-4854-9123-4523802d607f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:19.607722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25c998-e2da-4c36-88e5-3cf614b917b9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:19.696888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e22e-46b4-4854-9123-4523802d607f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:19.713951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:19.727696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25c998-e2da-4c36-88e5-3cf614b917b9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:19.738915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c125-b866-45a8-af54-75a327e2cc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:19.739821 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c125-b866-45a8-af54-75a327e2cc2f None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:19.740387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c125-b866-45a8-af54-75a327e2cc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:19.740811 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c125-b866-45a8-af54-75a327e2cc2f None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:19.741982 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c125-b866-45a8-af54-75a327e2cc2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:19.744354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c125-b866-45a8-af54-75a327e2cc2f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:19.765045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3528ef7-3465-4135-a616-54dcdcf8a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:19.765952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3528ef7-3465-4135-a616-54dcdcf8a59b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:19.766414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3528ef7-3465-4135-a616-54dcdcf8a59b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:19.766713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3528ef7-3465-4135-a616-54dcdcf8a59b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:19.771259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 175/350] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:08:19 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:19.772272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c125-b866-45a8-af54-75a327e2cc2f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:19.779454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3528ef7-3465-4135-a616-54dcdcf8a59b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:19.781224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3528ef7-3465-4135-a616-54dcdcf8a59b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b3528ef7-3465-4135-a616-54dcdcf8a59b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:19.799981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:19.801118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:19.802133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:19.802133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:19.802133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:19.803633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 176/351] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:19.812876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3528ef7-3465-4135-a616-54dcdcf8a59b None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:19.840383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:19.926894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c125-b866-45a8-af54-75a327e2cc2f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:20.009531 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305d5b1-2b0f-4d86-8d38-4da36cd6e7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:20.010360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305d5b1-2b0f-4d86-8d38-4da36cd6e7aa None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:20.011656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305d5b1-2b0f-4d86-8d38-4da36cd6e7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:20.012071 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305d5b1-2b0f-4d86-8d38-4da36cd6e7aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:20.029378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305d5b1-2b0f-4d86-8d38-4da36cd6e7aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:20.031029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305d5b1-2b0f-4d86-8d38-4da36cd6e7aa None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:20.036109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3528ef7-3465-4135-a616-54dcdcf8a59b None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-6305d5b1-2b0f-4d86-8d38-4da36cd6e7aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:20.047398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:20.048493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:20.049377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:20.049377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:20.049377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:20.050773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 176/352] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:20.057155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305d5b1-2b0f-4d86-8d38-4da36cd6e7aa None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:20.081581 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:20.088998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412aed1-414d-4b55-92fb-afa791134d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:20.089610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412aed1-414d-4b55-92fb-afa791134d8a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:20.089887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412aed1-414d-4b55-92fb-afa791134d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:20.090158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412aed1-414d-4b55-92fb-afa791134d8a None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:20.090792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412aed1-414d-4b55-92fb-afa791134d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:20.091094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412aed1-414d-4b55-92fb-afa791134d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:20.092664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412aed1-414d-4b55-92fb-afa791134d8a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:20.108420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 177/353] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:20.115315 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412aed1-414d-4b55-92fb-afa791134d8a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:20.193438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305d5b1-2b0f-4d86-8d38-4da36cd6e7aa None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:20.195881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:20.242429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d0167-1a7e-401d-bd65-9dc41b6ecf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:20.243056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d0167-1a7e-401d-bd65-9dc41b6ecf02 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:20.243428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d0167-1a7e-401d-bd65-9dc41b6ecf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:20.243705 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d0167-1a7e-401d-bd65-9dc41b6ecf02 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:20.244354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d0167-1a7e-401d-bd65-9dc41b6ecf02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:20.244709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d0167-1a7e-401d-bd65-9dc41b6ecf02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:20.246072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412aed1-414d-4b55-92fb-afa791134d8a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:20.246181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d0167-1a7e-401d-bd65-9dc41b6ecf02 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:20.277834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 177/354] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:20.280071 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372cd4b-ec8f-4dc7-9d43-77645e7cb26c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:20.280415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372cd4b-ec8f-4dc7-9d43-77645e7cb26c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:20.280686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372cd4b-ec8f-4dc7-9d43-77645e7cb26c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:20.282025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 178/355] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:20.282893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372cd4b-ec8f-4dc7-9d43-77645e7cb26c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:20.294236 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9799d-58d9-498b-8330-7ac3e536c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:20.294873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9799d-58d9-498b-8330-7ac3e536c816 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:20.295121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9799d-58d9-498b-8330-7ac3e536c816 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:20.295433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9799d-58d9-498b-8330-7ac3e536c816 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:20.296079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9799d-58d9-498b-8330-7ac3e536c816 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:20.297613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9799d-58d9-498b-8330-7ac3e536c816 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:20.325980 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 178/356] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:08:20 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:20.327155 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f605-1318-4e7f-a0e8-e2404ed22874 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:20.327465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f605-1318-4e7f-a0e8-e2404ed22874 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:20.327745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322f605-1318-4e7f-a0e8-e2404ed22874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:20.354075 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3322f605-1318-4e7f-a0e8-e2404ed22874 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:20.355446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3322f605-1318-4e7f-a0e8-e2404ed22874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:20.471690 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:20.506863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372cd4b-ec8f-4dc7-9d43-77645e7cb26c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:20.527040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 179/357] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:20.572310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc34445-ed65-49cc-9768-33f8c4abfcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:20.572927 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc34445-ed65-49cc-9768-33f8c4abfcf3 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:20.573263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc34445-ed65-49cc-9768-33f8c4abfcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:20.573798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc34445-ed65-49cc-9768-33f8c4abfcf3 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:20.574554 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc34445-ed65-49cc-9768-33f8c4abfcf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:20.576045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc34445-ed65-49cc-9768-33f8c4abfcf3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:20.601778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 179/358] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:08:20 2022] POST /identity/v3/users => generated 249 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:08:20.815125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322f605-1318-4e7f-a0e8-e2404ed22874 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:20.922318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322f605-1318-4e7f-a0e8-e2404ed22874 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:20.962266 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9d832-e09b-4916-889e-72a2d6be86d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:20.962887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9d832-e09b-4916-889e-72a2d6be86d1 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:20.963167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9d832-e09b-4916-889e-72a2d6be86d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:20.963463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9d832-e09b-4916-889e-72a2d6be86d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:20.964152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9d832-e09b-4916-889e-72a2d6be86d1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:20.965532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9d832-e09b-4916-889e-72a2d6be86d1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:20.975718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.sql.core [None req-8cd9d832-e09b-4916-889e-72a2d6be86d1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 21 21:08:20.975718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 21 21:08:20.975718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [parameters: {'id': '689a6d7301264af8a97b96500eda4df7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 21 21:08:20.975718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81347) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-8cd9d832-e09b-4916-889e-72a2d6be86d1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result = self._query(query) Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application conn.query(q) Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result.read() Oct 21 21:08:20.994094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return ref.to_dict() Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 21 21:08:20.995058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application next(self.gen) Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application yield resource Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application next(self.gen) Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.session.rollback() Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.force_reraise() Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise self.value Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application session.commit() Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 21 21:08:20.996165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._prepare_impl() Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.session.flush() Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._flush(objects) Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application compat.raise_( Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application flush_context.execute() Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rec.execute(self) Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 21 21:08:20.997927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 21 21:08:21.000012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result = self._query(query) Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application conn.query(q) Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result.read() Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 21 21:08:21.002252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [parameters: {'id': '689a6d7301264af8a97b96500eda4df7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:21.011157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 21 21:08:21.013151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:21.015149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 180/359] 10.222.0.23 () {60 vars in 1131 bytes} [Fri Oct 21 21:08:20 2022] POST /identity/v3/roles => generated 144 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:21.015365 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc34445-ed65-49cc-9768-33f8c4abfcf3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:21.026820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:21.148881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc34445-ed65-49cc-9768-33f8c4abfcf3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:21.189886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c61d1-142a-4507-b070-75855875d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:21.191178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c61d1-142a-4507-b070-75855875d316 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:21.191487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c61d1-142a-4507-b070-75855875d316 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:21.191761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c61d1-142a-4507-b070-75855875d316 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:21.207305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c61d1-142a-4507-b070-75855875d316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-763c61d1-142a-4507-b070-75855875d316 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:21.212778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:21.214845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:21.216838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 180/360] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:08:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:21.223263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9d832-e09b-4916-889e-72a2d6be86d1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:21.281565 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:21.353119 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9d832-e09b-4916-889e-72a2d6be86d1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:21.406271 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4ae4b-1332-44aa-86a3-9a1af39796ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:21.406817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4ae4b-1332-44aa-86a3-9a1af39796ca None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:21.407095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4ae4b-1332-44aa-86a3-9a1af39796ca None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:21.407399 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4ae4b-1332-44aa-86a3-9a1af39796ca None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:21.408073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4ae4b-1332-44aa-86a3-9a1af39796ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:21.408376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4ae4b-1332-44aa-86a3-9a1af39796ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:21.409772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4ae4b-1332-44aa-86a3-9a1af39796ca None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:21.422016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 181/361] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:21.956248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb6840-90d3-4c35-aad1-e8c5284ff9f5 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:21.956928 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb6840-90d3-4c35-aad1-e8c5284ff9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:21.956928 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb6840-90d3-4c35-aad1-e8c5284ff9f5 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:21.958195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 181/362] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:21.963546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efe2ec-93c5-4967-960f-33c3caa4adc5 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:21.963836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efe2ec-93c5-4967-960f-33c3caa4adc5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:21.964109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efe2ec-93c5-4967-960f-33c3caa4adc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:21.983999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-96efe2ec-93c5-4967-960f-33c3caa4adc5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:21.985183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-96efe2ec-93c5-4967-960f-33c3caa4adc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:22.063294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 182/363] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:22.429620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb6840-90d3-4c35-aad1-e8c5284ff9f5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:22.453790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899bdc0-fe85-4de1-b3ef-e89ed9c95d14 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:22.454294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899bdc0-fe85-4de1-b3ef-e89ed9c95d14 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:22.454368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899bdc0-fe85-4de1-b3ef-e89ed9c95d14 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:22.456024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 183/364] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:22.468000 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd75e4-98c4-40bd-9934-ee5d4161b7be None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:22.468290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd75e4-98c4-40bd-9934-ee5d4161b7be None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:22.468552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd75e4-98c4-40bd-9934-ee5d4161b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:22.501043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a9dd75e4-98c4-40bd-9934-ee5d4161b7be None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:22.502220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a9dd75e4-98c4-40bd-9934-ee5d4161b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:22.557805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:22.559534 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:22.596392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb6840-90d3-4c35-aad1-e8c5284ff9f5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:22.612607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 184/365] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:22.651156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f18c9-2d6c-473a-b4a5-8e3f31702dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:22.651815 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f18c9-2d6c-473a-b4a5-8e3f31702dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:22.652095 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f18c9-2d6c-473a-b4a5-8e3f31702dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:22.652368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f18c9-2d6c-473a-b4a5-8e3f31702dd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:22.668821 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f18c9-2d6c-473a-b4a5-8e3f31702dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-fc5f18c9-2d6c-473a-b4a5-8e3f31702dd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:22.674132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:22.675037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:22.676406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 182/366] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:22.681070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd75e4-98c4-40bd-9934-ee5d4161b7be None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:22.793566 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd75e4-98c4-40bd-9934-ee5d4161b7be None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:22.829272 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104abbdb-78cf-4756-a196-a6e5260b57e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:22.829887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104abbdb-78cf-4756-a196-a6e5260b57e7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:22.830169 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104abbdb-78cf-4756-a196-a6e5260b57e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:22.830445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104abbdb-78cf-4756-a196-a6e5260b57e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:22.831640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104abbdb-78cf-4756-a196-a6e5260b57e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:22.831949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104abbdb-78cf-4756-a196-a6e5260b57e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:22.833322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104abbdb-78cf-4756-a196-a6e5260b57e7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:22.843228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 185/367] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:22.849185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f18c9-2d6c-473a-b4a5-8e3f31702dd1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:22.970314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f18c9-2d6c-473a-b4a5-8e3f31702dd1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:23.007871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca5248-dae9-4770-8b4c-d38a3f74ca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:23.008508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca5248-dae9-4770-8b4c-d38a3f74ca90 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.008887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca5248-dae9-4770-8b4c-d38a3f74ca90 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.010427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07364101-60a4-42e7-901f-0638bb26c5f3 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.010709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07364101-60a4-42e7-901f-0638bb26c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.010983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07364101-60a4-42e7-901f-0638bb26c5f3 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.012236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca5248-dae9-4770-8b4c-d38a3f74ca90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.013913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 186/368] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:08:23.017949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07364101-60a4-42e7-901f-0638bb26c5f3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:23.020197 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:23.025413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca5248-dae9-4770-8b4c-d38a3f74ca90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:23.026875 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca5248-dae9-4770-8b4c-d38a3f74ca90 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-6cca5248-dae9-4770-8b4c-d38a3f74ca90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:23.045194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:23.046138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:23.046988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:23.046988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:23.046988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:23.046988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 183/369] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:23.051622 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ab2c9-85be-4073-b4f0-440021fa620e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.051922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ab2c9-85be-4073-b4f0-440021fa620e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.052201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ab2c9-85be-4073-b4f0-440021fa620e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.064338 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:23.076832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9c1ab2c9-85be-4073-b4f0-440021fa620e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:23.078077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9c1ab2c9-85be-4073-b4f0-440021fa620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:23.156526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 184/370] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:23.157930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ab2c9-85be-4073-b4f0-440021fa620e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:23.172879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07364101-60a4-42e7-901f-0638bb26c5f3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:23.239285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca70b72-5249-4284-bb39-2401f1dae087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:23.239848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca70b72-5249-4284-bb39-2401f1dae087 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.240125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca70b72-5249-4284-bb39-2401f1dae087 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.240396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca70b72-5249-4284-bb39-2401f1dae087 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.258408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca70b72-5249-4284-bb39-2401f1dae087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-aca70b72-5249-4284-bb39-2401f1dae087 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:23.263238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:23.264179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:23.264961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:23.271972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ab2c9-85be-4073-b4f0-440021fa620e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:23.272773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 187/371] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:23.290456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca70b72-5249-4284-bb39-2401f1dae087 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:23.302301 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:23.319206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c44e55-0a89-4fd8-af44-cf5042121d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:23.320265 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c44e55-0a89-4fd8-af44-cf5042121d7f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.320792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c44e55-0a89-4fd8-af44-cf5042121d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.321359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c44e55-0a89-4fd8-af44-cf5042121d7f None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.322199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c44e55-0a89-4fd8-af44-cf5042121d7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:23.322699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c44e55-0a89-4fd8-af44-cf5042121d7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:23.324590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c44e55-0a89-4fd8-af44-cf5042121d7f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:23.337234 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 185/372] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:23.346531 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c44e55-0a89-4fd8-af44-cf5042121d7f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:23.439649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:23.460701 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca70b72-5249-4284-bb39-2401f1dae087 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:23.501029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c44e55-0a89-4fd8-af44-cf5042121d7f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:23.508357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf83347-3dda-45f5-8880-95f58c99a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:23.508973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf83347-3dda-45f5-8880-95f58c99a5da None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.509767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf83347-3dda-45f5-8880-95f58c99a5da None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.510048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf83347-3dda-45f5-8880-95f58c99a5da None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.510718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf83347-3dda-45f5-8880-95f58c99a5da None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:23.511025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf83347-3dda-45f5-8880-95f58c99a5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:23.513391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf83347-3dda-45f5-8880-95f58c99a5da None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:23.524001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 188/373] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:23.525040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf83347-3dda-45f5-8880-95f58c99a5da None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:23.538973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3310e8-2be4-4b23-8fe5-3fb218586321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:23.539733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3310e8-2be4-4b23-8fe5-3fb218586321 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.540084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3310e8-2be4-4b23-8fe5-3fb218586321 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.540473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3310e8-2be4-4b23-8fe5-3fb218586321 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.548528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3310e8-2be4-4b23-8fe5-3fb218586321 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:23.550629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3310e8-2be4-4b23-8fe5-3fb218586321 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-2e3310e8-2be4-4b23-8fe5-3fb218586321 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:23.563832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:23.564742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:23.566232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 186/374] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 21 21:08:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:23.566836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3310e8-2be4-4b23-8fe5-3fb218586321 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:23.613390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:23.639298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf83347-3dda-45f5-8880-95f58c99a5da None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:23.672849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d80bb2-466a-457f-a618-f2a8d4290998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:23.673481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d80bb2-466a-457f-a618-f2a8d4290998 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.673763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d80bb2-466a-457f-a618-f2a8d4290998 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.674065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d80bb2-466a-457f-a618-f2a8d4290998 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.680384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3310e8-2be4-4b23-8fe5-3fb218586321 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:23.684934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d80bb2-466a-457f-a618-f2a8d4290998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-a0d80bb2-466a-457f-a618-f2a8d4290998 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:23.690285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:23.691172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:23.692014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 189/375] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:23.692673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d80bb2-466a-457f-a618-f2a8d4290998 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:23.708813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:23.719623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6006ae5-1fbc-4623-9d85-2c339cb4c64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:23.720260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6006ae5-1fbc-4623-9d85-2c339cb4c64c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.720933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6006ae5-1fbc-4623-9d85-2c339cb4c64c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.721230 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6006ae5-1fbc-4623-9d85-2c339cb4c64c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.736359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6006ae5-1fbc-4623-9d85-2c339cb4c64c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:23.738477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6006ae5-1fbc-4623-9d85-2c339cb4c64c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-f6006ae5-1fbc-4623-9d85-2c339cb4c64c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:23.753123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:23.754183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:23.755220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:23.755220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:23.755220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:23.755220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 187/376] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:23.755902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a4c85-8bc3-4a65-b5e8-953598668803 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.755902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a4c85-8bc3-4a65-b5e8-953598668803 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.755902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a4c85-8bc3-4a65-b5e8-953598668803 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.761222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 188/377] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:23.761222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a4c85-8bc3-4a65-b5e8-953598668803 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:23.810688 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d80bb2-466a-457f-a618-f2a8d4290998 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:23.844047 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22e6d0-b02a-410d-bc5a-ee033ddccc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:23.844655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22e6d0-b02a-410d-bc5a-ee033ddccc34 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.844938 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22e6d0-b02a-410d-bc5a-ee033ddccc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.845214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22e6d0-b02a-410d-bc5a-ee033ddccc34 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.845951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22e6d0-b02a-410d-bc5a-ee033ddccc34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:23.846261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22e6d0-b02a-410d-bc5a-ee033ddccc34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:23.848268 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22e6d0-b02a-410d-bc5a-ee033ddccc34 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:23.853888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:23.865595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a4c85-8bc3-4a65-b5e8-953598668803 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:23.894655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 190/378] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 21 21:08:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:23.894655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22e6d0-b02a-410d-bc5a-ee033ddccc34 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:23.903970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08e59-159d-4cf5-a07c-650e42706796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:23.904581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08e59-159d-4cf5-a07c-650e42706796 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.904860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08e59-159d-4cf5-a07c-650e42706796 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.905134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08e59-159d-4cf5-a07c-650e42706796 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.905793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c08e59-159d-4cf5-a07c-650e42706796 None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:23.906090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c08e59-159d-4cf5-a07c-650e42706796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:23.907485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c08e59-159d-4cf5-a07c-650e42706796 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:23.916999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 189/379] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:23.918231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634322-ae70-4d49-8c4f-73f60f1e0cca None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:23.918513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634322-ae70-4d49-8c4f-73f60f1e0cca None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:23.918790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634322-ae70-4d49-8c4f-73f60f1e0cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:23.937504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-10634322-ae70-4d49-8c4f-73f60f1e0cca None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:23.938692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-10634322-ae70-4d49-8c4f-73f60f1e0cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:23.967041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:24.004395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22e6d0-b02a-410d-bc5a-ee033ddccc34 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.015089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 190/380] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:24.016512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10634322-ae70-4d49-8c4f-73f60f1e0cca None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.051672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2c1e0-8095-4511-873e-476dfc68eedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.054395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2c1e0-8095-4511-873e-476dfc68eedb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.054395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2c1e0-8095-4511-873e-476dfc68eedb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.054395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2c1e0-8095-4511-873e-476dfc68eedb None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.054395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2c1e0-8095-4511-873e-476dfc68eedb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:24.054395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2c1e0-8095-4511-873e-476dfc68eedb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:24.055502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2c1e0-8095-4511-873e-476dfc68eedb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:24.072739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 191/381] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:24.073104 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2c1e0-8095-4511-873e-476dfc68eedb None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.131930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:24.150683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10634322-ae70-4d49-8c4f-73f60f1e0cca None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.187567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35aa93-4141-4f51-881f-1077ad73aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.188452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35aa93-4141-4f51-881f-1077ad73aad1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.188948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35aa93-4141-4f51-881f-1077ad73aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.189353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35aa93-4141-4f51-881f-1077ad73aad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.200899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35aa93-4141-4f51-881f-1077ad73aad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:24.202716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35aa93-4141-4f51-881f-1077ad73aad1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:24.214703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2c1e0-8095-4511-873e-476dfc68eedb None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-ad35aa93-4141-4f51-881f-1077ad73aad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:24.221904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:24.222893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:24.223864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:24.223864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:24.223864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:24.226266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 191/382] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:24.227671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35aa93-4141-4f51-881f-1077ad73aad1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.249252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:24.260791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35a9b-b4d6-4882-8a80-f0db1c7e6f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.261531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35a9b-b4d6-4882-8a80-f0db1c7e6f9c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.261904 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35a9b-b4d6-4882-8a80-f0db1c7e6f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.262186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e35a9b-b4d6-4882-8a80-f0db1c7e6f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.278452 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e35a9b-b4d6-4882-8a80-f0db1c7e6f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:24.280447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e35a9b-b4d6-4882-8a80-f0db1c7e6f9c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-75e35a9b-b4d6-4882-8a80-f0db1c7e6f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:24.300849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:24.301783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:24.303200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:24.303200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:24.303200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:24.303200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 192/383] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:24.303200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35a9b-b4d6-4882-8a80-f0db1c7e6f9c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.347035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35aa93-4141-4f51-881f-1077ad73aad1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.385429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3b355-997b-4f96-a3d5-6a8614ac6ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.386057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3b355-997b-4f96-a3d5-6a8614ac6ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.386335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3b355-997b-4f96-a3d5-6a8614ac6ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.386767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3b355-997b-4f96-a3d5-6a8614ac6ec5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.389874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:24.395170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3b355-997b-4f96-a3d5-6a8614ac6ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:24.396857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3b355-997b-4f96-a3d5-6a8614ac6ec5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:24.405011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e35a9b-b4d6-4882-8a80-f0db1c7e6f9c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-39b3b355-997b-4f96-a3d5-6a8614ac6ec5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:24.408132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:24.409735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 192/384] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:24.410626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3b355-997b-4f96-a3d5-6a8614ac6ec5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.441490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238463c9-492c-4e40-b609-bb0c6a2b4420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.442089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238463c9-492c-4e40-b609-bb0c6a2b4420 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.442364 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238463c9-492c-4e40-b609-bb0c6a2b4420 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.442633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238463c9-492c-4e40-b609-bb0c6a2b4420 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.443262 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238463c9-492c-4e40-b609-bb0c6a2b4420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:24.443595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238463c9-492c-4e40-b609-bb0c6a2b4420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:24.444943 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238463c9-492c-4e40-b609-bb0c6a2b4420 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:24.456426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 193/385] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:24.457195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238463c9-492c-4e40-b609-bb0c6a2b4420 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.497128 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:24.509886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3b355-997b-4f96-a3d5-6a8614ac6ec5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.543050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b82d59-b339-460a-bff6-bfdce13caafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.543609 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b82d59-b339-460a-bff6-bfdce13caafe None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.543894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b82d59-b339-460a-bff6-bfdce13caafe None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.544170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b82d59-b339-460a-bff6-bfdce13caafe None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.544812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b82d59-b339-460a-bff6-bfdce13caafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:24.545116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b82d59-b339-460a-bff6-bfdce13caafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:24.546495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b82d59-b339-460a-bff6-bfdce13caafe None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:24.555738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238463c9-492c-4e40-b609-bb0c6a2b4420 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.558464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 193/386] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:24.559653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3a91-81f5-485b-89b1-db560674e9c6 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.559938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3a91-81f5-485b-89b1-db560674e9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.560213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3a91-81f5-485b-89b1-db560674e9c6 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.561404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 194/387] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:24.562102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d3a91-81f5-485b-89b1-db560674e9c6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.589523 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2d89-52b4-453d-bf79-524e9f9d6f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.590152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2d89-52b4-453d-bf79-524e9f9d6f7b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.590432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2d89-52b4-453d-bf79-524e9f9d6f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.590707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2d89-52b4-453d-bf79-524e9f9d6f7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.601080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2d89-52b4-453d-bf79-524e9f9d6f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-989d2d89-52b4-453d-bf79-524e9f9d6f7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:24.606034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:24.607123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 194/388] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:24.613221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2d89-52b4-453d-bf79-524e9f9d6f7b None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.626816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:24.671093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d3a91-81f5-485b-89b1-db560674e9c6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.703165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:24.705166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c3f6f-87de-4126-ac0a-6590cbc9e498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.705822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c3f6f-87de-4126-ac0a-6590cbc9e498 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.706118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c3f6f-87de-4126-ac0a-6590cbc9e498 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.706394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c3f6f-87de-4126-ac0a-6590cbc9e498 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.707105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2d89-52b4-453d-bf79-524e9f9d6f7b None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.707222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c3f6f-87de-4126-ac0a-6590cbc9e498 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:24.707435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c3f6f-87de-4126-ac0a-6590cbc9e498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:24.708849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c3f6f-87de-4126-ac0a-6590cbc9e498 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:24.742100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09fcd2-7a11-4be2-9a69-4c017affcb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.742721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09fcd2-7a11-4be2-9a69-4c017affcb98 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.742998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09fcd2-7a11-4be2-9a69-4c017affcb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.743287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09fcd2-7a11-4be2-9a69-4c017affcb98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.747848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 195/389] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:24.748506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c3f6f-87de-4126-ac0a-6590cbc9e498 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.749962 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09fcd2-7a11-4be2-9a69-4c017affcb98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:24.751610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09fcd2-7a11-4be2-9a69-4c017affcb98 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-1b09fcd2-7a11-4be2-9a69-4c017affcb98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:24.764211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:24.765252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:24.766120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:24.766120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:24.766120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:24.766120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:24.766120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:24.766120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:24.766120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:24.766120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:24.766120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 195/390] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:24.766778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e534797-fa2e-4e7d-bcc1-fa7ebd179124 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.767062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e534797-fa2e-4e7d-bcc1-fa7ebd179124 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.767358 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e534797-fa2e-4e7d-bcc1-fa7ebd179124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.785710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6e534797-fa2e-4e7d-bcc1-fa7ebd179124 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:24.786881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6e534797-fa2e-4e7d-bcc1-fa7ebd179124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:24.849638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c3f6f-87de-4126-ac0a-6590cbc9e498 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.852774 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 196/391] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:24.853573 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e534797-fa2e-4e7d-bcc1-fa7ebd179124 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.863140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:24.884331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c00e32-bd0f-4099-92df-45437dd1cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.884959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00e32-bd0f-4099-92df-45437dd1cf5e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.885240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00e32-bd0f-4099-92df-45437dd1cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.885530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00e32-bd0f-4099-92df-45437dd1cf5e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.892871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c00e32-bd0f-4099-92df-45437dd1cf5e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:24.894905 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c00e32-bd0f-4099-92df-45437dd1cf5e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-78c00e32-bd0f-4099-92df-45437dd1cf5e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:24.906257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:24.907189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:24.908207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 196/392] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:24.913075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c00e32-bd0f-4099-92df-45437dd1cf5e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:24.949095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:24.964294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e534797-fa2e-4e7d-bcc1-fa7ebd179124 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:24.998017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7ca3-e25f-4ab5-953a-5f2e554423c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:24.998619 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7ca3-e25f-4ab5-953a-5f2e554423c6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:24.998894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7ca3-e25f-4ab5-953a-5f2e554423c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:24.999163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7ca3-e25f-4ab5-953a-5f2e554423c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:24.999851 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7ca3-e25f-4ab5-953a-5f2e554423c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:25.000149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7ca3-e25f-4ab5-953a-5f2e554423c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.001509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7ca3-e25f-4ab5-953a-5f2e554423c6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.009584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 197/393] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:25.010274 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7ca3-e25f-4ab5-953a-5f2e554423c6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.017518 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c00e32-bd0f-4099-92df-45437dd1cf5e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.056602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3eb0f7-991d-4715-a19d-5958f834c056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.057401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eb0f7-991d-4715-a19d-5958f834c056 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.057682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eb0f7-991d-4715-a19d-5958f834c056 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.057949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eb0f7-991d-4715-a19d-5958f834c056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.069328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3eb0f7-991d-4715-a19d-5958f834c056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.070813 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3eb0f7-991d-4715-a19d-5958f834c056 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-cc3eb0f7-991d-4715-a19d-5958f834c056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:25.086542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:25.087736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:25.088605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:25.088605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:25.088605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:25.088605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 197/394] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:25.088605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3eb0f7-991d-4715-a19d-5958f834c056 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.117129 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7ca3-e25f-4ab5-953a-5f2e554423c6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.123072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:25.151710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfde49-e771-4859-b0af-657cfaf1dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.152314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfde49-e771-4859-b0af-657cfaf1dda4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.152614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfde49-e771-4859-b0af-657cfaf1dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.152881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfde49-e771-4859-b0af-657cfaf1dda4 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.153564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfde49-e771-4859-b0af-657cfaf1dda4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:25.153864 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfde49-e771-4859-b0af-657cfaf1dda4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.155277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfde49-e771-4859-b0af-657cfaf1dda4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.172137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 198/395] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:25.172917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfde49-e771-4859-b0af-657cfaf1dda4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.184598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:25.196523 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3eb0f7-991d-4715-a19d-5958f834c056 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.230582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e6751-c1bb-45e3-895d-628e1065db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.231187 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e6751-c1bb-45e3-895d-628e1065db74 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.231499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e6751-c1bb-45e3-895d-628e1065db74 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.231778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e6751-c1bb-45e3-895d-628e1065db74 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.232502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e6751-c1bb-45e3-895d-628e1065db74 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:25.232808 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e6751-c1bb-45e3-895d-628e1065db74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.234240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e6751-c1bb-45e3-895d-628e1065db74 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.250733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 198/396] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:25.251576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e6751-c1bb-45e3-895d-628e1065db74 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.274733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfde49-e771-4859-b0af-657cfaf1dda4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.307500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c702e-2e7a-4ebe-9dfc-70788f792bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.308131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c702e-2e7a-4ebe-9dfc-70788f792bcc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.308419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c702e-2e7a-4ebe-9dfc-70788f792bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.308703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c702e-2e7a-4ebe-9dfc-70788f792bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.320411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c702e-2e7a-4ebe-9dfc-70788f792bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.321335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c702e-2e7a-4ebe-9dfc-70788f792bcc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-817c702e-2e7a-4ebe-9dfc-70788f792bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:25.336702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:25.337790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:25.338827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:25.338827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:25.338827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:25.338827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 199/397] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:25.338827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c702e-2e7a-4ebe-9dfc-70788f792bcc None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.339501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:25.355172 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e6751-c1bb-45e3-895d-628e1065db74 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.388975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1931142-9117-4fed-9133-12db870a5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.389516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1931142-9117-4fed-9133-12db870a5c2c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.389803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1931142-9117-4fed-9133-12db870a5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.390074 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1931142-9117-4fed-9133-12db870a5c2c None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.390708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1931142-9117-4fed-9133-12db870a5c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:25.391011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1931142-9117-4fed-9133-12db870a5c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.392391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1931142-9117-4fed-9133-12db870a5c2c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.401757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:25.403887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 199/398] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:25.404796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1931142-9117-4fed-9133-12db870a5c2c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.439712 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c702e-2e7a-4ebe-9dfc-70788f792bcc None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.472894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01602524-8194-422f-9a26-e5afc89c7cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.473508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01602524-8194-422f-9a26-e5afc89c7cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.473785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01602524-8194-422f-9a26-e5afc89c7cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.474052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01602524-8194-422f-9a26-e5afc89c7cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.486014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01602524-8194-422f-9a26-e5afc89c7cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.488105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01602524-8194-422f-9a26-e5afc89c7cc0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-01602524-8194-422f-9a26-e5afc89c7cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:25.502055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:25.507967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:25.508806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:25.508806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:25.508806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:25.508806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 200/399] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:25.508806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01602524-8194-422f-9a26-e5afc89c7cc0 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.509060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1931142-9117-4fed-9133-12db870a5c2c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.539496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ac037-ce52-4464-ab0d-241df0df95d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.540159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ac037-ce52-4464-ab0d-241df0df95d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.540442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ac037-ce52-4464-ab0d-241df0df95d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.540720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ac037-ce52-4464-ab0d-241df0df95d6 None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/8afe54a4c63b4a50a6240293e2be6450/roles/9551be8340204b80958e4788f306cff6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.555118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ac037-ce52-4464-ab0d-241df0df95d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=8afe54a4c63b4a50a6240293e2be6450, role_id=9551be8340204b80958e4788f306cff6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.556595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ac037-ce52-4464-ab0d-241df0df95d6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.558865 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:25.569554 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 200/400] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:08:25 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/8afe54a4c63b4a50a6240293e2be6450/roles/9551be8340204b80958e4788f306cff6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:25.570387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ac037-ce52-4464-ab0d-241df0df95d6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.629666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01602524-8194-422f-9a26-e5afc89c7cc0 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.647123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:25.671094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea8fac-72fc-4158-9a15-41e5c5a09c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.671881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea8fac-72fc-4158-9a15-41e5c5a09c66 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.672163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea8fac-72fc-4158-9a15-41e5c5a09c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.672436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea8fac-72fc-4158-9a15-41e5c5a09c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.678394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ac037-ce52-4464-ab0d-241df0df95d6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.684908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea8fac-72fc-4158-9a15-41e5c5a09c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.686424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea8fac-72fc-4158-9a15-41e5c5a09c66 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-98ea8fac-72fc-4158-9a15-41e5c5a09c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:25.704729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:25.706006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:25.706853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:25.706853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:25.706853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:25.706853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 201/401] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:25.706853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea8fac-72fc-4158-9a15-41e5c5a09c66 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.719995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a87f3-8fa3-4d5f-a795-5167e99b9255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.720631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a87f3-8fa3-4d5f-a795-5167e99b9255 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.720915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a87f3-8fa3-4d5f-a795-5167e99b9255 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.721236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a87f3-8fa3-4d5f-a795-5167e99b9255 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.721953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a87f3-8fa3-4d5f-a795-5167e99b9255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:25.722248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a87f3-8fa3-4d5f-a795-5167e99b9255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.723728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a87f3-8fa3-4d5f-a795-5167e99b9255 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.736878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 201/402] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:25.738388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a87f3-8fa3-4d5f-a795-5167e99b9255 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.802645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:25.823802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea8fac-72fc-4158-9a15-41e5c5a09c66 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.853084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a87f3-8fa3-4d5f-a795-5167e99b9255 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:25.863048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95495dca-2f75-4937-863e-2209e9ba0cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.863703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95495dca-2f75-4937-863e-2209e9ba0cfc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.863983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95495dca-2f75-4937-863e-2209e9ba0cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.864264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95495dca-2f75-4937-863e-2209e9ba0cfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.870927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95495dca-2f75-4937-863e-2209e9ba0cfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.872406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95495dca-2f75-4937-863e-2209e9ba0cfc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-95495dca-2f75-4937-863e-2209e9ba0cfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:25.884961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:25.885840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:25.886718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:25.886718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:25.886718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:25.886718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:25.886718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:25.886718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:25.886718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:25.886718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:25.886718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 202/403] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:25.887171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95495dca-2f75-4937-863e-2209e9ba0cfc None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.896181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2b746-83c0-4286-991e-e9fcf5b3203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:25.896810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2b746-83c0-4286-991e-e9fcf5b3203a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:25.897425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2b746-83c0-4286-991e-e9fcf5b3203a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:25.897425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2b746-83c0-4286-991e-e9fcf5b3203a None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:25.898008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2b746-83c0-4286-991e-e9fcf5b3203a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:25.898307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2b746-83c0-4286-991e-e9fcf5b3203a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:25.899732 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2b746-83c0-4286-991e-e9fcf5b3203a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:25.913201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 202/404] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:25.916153 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2b746-83c0-4286-991e-e9fcf5b3203a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:25.918378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:25.995722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95495dca-2f75-4937-863e-2209e9ba0cfc None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:26.026159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2b746-83c0-4286-991e-e9fcf5b3203a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:26.033009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9101-d2c7-4027-a8bc-bff5ee11d2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:26.034068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9101-d2c7-4027-a8bc-bff5ee11d2cf None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:26.034351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9101-d2c7-4027-a8bc-bff5ee11d2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:26.034625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9101-d2c7-4027-a8bc-bff5ee11d2cf None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:26.035332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9101-d2c7-4027-a8bc-bff5ee11d2cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:26.035994 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9101-d2c7-4027-a8bc-bff5ee11d2cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:26.037682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9101-d2c7-4027-a8bc-bff5ee11d2cf None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:26.042511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:26.059222 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 203/405] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:26.060138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9101-d2c7-4027-a8bc-bff5ee11d2cf None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:26.071450 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72512e9a-8031-4758-80c5-3008762f77b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:26.072089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72512e9a-8031-4758-80c5-3008762f77b2 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:26.072372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72512e9a-8031-4758-80c5-3008762f77b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:26.072647 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72512e9a-8031-4758-80c5-3008762f77b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:26.082026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72512e9a-8031-4758-80c5-3008762f77b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:26.083666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72512e9a-8031-4758-80c5-3008762f77b2 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-72512e9a-8031-4758-80c5-3008762f77b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:26.096339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:26.097284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 203/406] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:26.098183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72512e9a-8031-4758-80c5-3008762f77b2 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:26.152627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:26.170960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9101-d2c7-4027-a8bc-bff5ee11d2cf None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:26.208841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72512e9a-8031-4758-80c5-3008762f77b2 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:26.210687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cafc7-653d-4562-8fb7-ed05ba1c38fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:26.211320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cafc7-653d-4562-8fb7-ed05ba1c38fb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:26.212152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cafc7-653d-4562-8fb7-ed05ba1c38fb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:26.212152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cafc7-653d-4562-8fb7-ed05ba1c38fb None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:26.212526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cafc7-653d-4562-8fb7-ed05ba1c38fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:26.212827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cafc7-653d-4562-8fb7-ed05ba1c38fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:26.214243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cafc7-653d-4562-8fb7-ed05ba1c38fb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:26.230679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 204/407] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:26.230679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cafc7-653d-4562-8fb7-ed05ba1c38fb None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:26.251015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c9e3d-5cab-4fae-be23-209e3ed6aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:26.251663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c9e3d-5cab-4fae-be23-209e3ed6aa1c None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:26.251946 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c9e3d-5cab-4fae-be23-209e3ed6aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:26.252219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c9e3d-5cab-4fae-be23-209e3ed6aa1c None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:26.253466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c9e3d-5cab-4fae-be23-209e3ed6aa1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:26.254899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c9e3d-5cab-4fae-be23-209e3ed6aa1c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:26.277007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 204/408] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:08:26 2022] POST /identity/v3/users => generated 247 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:26.286996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c9e3d-5cab-4fae-be23-209e3ed6aa1c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:26.333294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:26.360400 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cafc7-653d-4562-8fb7-ed05ba1c38fb None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:26.410281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc04210-1df3-483c-b0c8-c92a5018fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:26.411615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04210-1df3-483c-b0c8-c92a5018fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:26.412071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04210-1df3-483c-b0c8-c92a5018fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:26.412731 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04210-1df3-483c-b0c8-c92a5018fdd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:26.417626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c9e3d-5cab-4fae-be23-209e3ed6aa1c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:26.422949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc04210-1df3-483c-b0c8-c92a5018fdd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:26.425264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc04210-1df3-483c-b0c8-c92a5018fdd6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-8dc04210-1df3-483c-b0c8-c92a5018fdd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:26.442659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:26.443822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:26.444874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:26.444874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:26.444874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:26.444874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:26.444874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:26.444874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:26.444874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:26.444874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:26.447172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 205/409] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:26.448316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc04210-1df3-483c-b0c8-c92a5018fdd6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:26.460197 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:26.472548 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1521c4-3860-4e1e-8322-a33708bf4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:26.473164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1521c4-3860-4e1e-8322-a33708bf4022 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:26.473448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1521c4-3860-4e1e-8322-a33708bf4022 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:26.473721 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1521c4-3860-4e1e-8322-a33708bf4022 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:26.474465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1521c4-3860-4e1e-8322-a33708bf4022 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:26.474773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1521c4-3860-4e1e-8322-a33708bf4022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:26.476382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1521c4-3860-4e1e-8322-a33708bf4022 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:26.496108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 205/410] 10.222.0.23 () {56 vars in 1139 bytes} [Fri Oct 21 21:08:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:26.497111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1521c4-3860-4e1e-8322-a33708bf4022 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:26.569862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc04210-1df3-483c-b0c8-c92a5018fdd6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:26.588244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:26.601687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1521c4-3860-4e1e-8322-a33708bf4022 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:26.609340 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e0cf-9c46-4874-a2f9-7695a2885e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:26.610216 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e0cf-9c46-4874-a2f9-7695a2885e50 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:26.610641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e0cf-9c46-4874-a2f9-7695a2885e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:26.611161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3e0cf-9c46-4874-a2f9-7695a2885e50 None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/59ec1b2a49264e4e9218b65f9ff114b9/roles/9551be8340204b80958e4788f306cff6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:26.627836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3e0cf-9c46-4874-a2f9-7695a2885e50 None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=59ec1b2a49264e4e9218b65f9ff114b9, role_id=9551be8340204b80958e4788f306cff6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:26.629704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3e0cf-9c46-4874-a2f9-7695a2885e50 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:26.637353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc36da7-3eb8-44e8-8459-c4b96f7efe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:26.637991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc36da7-3eb8-44e8-8459-c4b96f7efe87 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:26.638276 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc36da7-3eb8-44e8-8459-c4b96f7efe87 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:26.638552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc36da7-3eb8-44e8-8459-c4b96f7efe87 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:26.639257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc36da7-3eb8-44e8-8459-c4b96f7efe87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:26.639583 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc36da7-3eb8-44e8-8459-c4b96f7efe87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:26.641047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc36da7-3eb8-44e8-8459-c4b96f7efe87 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:26.646419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 206/411] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:08:26 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/59ec1b2a49264e4e9218b65f9ff114b9/roles/9551be8340204b80958e4788f306cff6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:26.647555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e0cf-9c46-4874-a2f9-7695a2885e50 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:26.676247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 206/412] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:26.682924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc36da7-3eb8-44e8-8459-c4b96f7efe87 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:26.756664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:26.799805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc36da7-3eb8-44e8-8459-c4b96f7efe87 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:26.839798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5fc1-28e9-43e6-97e3-4c33d06bd656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:26.839798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5fc1-28e9-43e6-97e3-4c33d06bd656 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:26.839798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5fc1-28e9-43e6-97e3-4c33d06bd656 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:26.839798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5fc1-28e9-43e6-97e3-4c33d06bd656 None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/31f812676e6f4b258f556d5a0b54dc46/roles/9551be8340204b80958e4788f306cff6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:26.850773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3e0cf-9c46-4874-a2f9-7695a2885e50 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:26.856187 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5fc1-28e9-43e6-97e3-4c33d06bd656 None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=31f812676e6f4b258f556d5a0b54dc46, role_id=9551be8340204b80958e4788f306cff6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:26.857806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5fc1-28e9-43e6-97e3-4c33d06bd656 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:26.868093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:26.882880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 207/413] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:08:26 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/31f812676e6f4b258f556d5a0b54dc46/roles/9551be8340204b80958e4788f306cff6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:08:26.901815 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c2f0-7c8f-43ee-b6a6-8f429c6adb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:26.902779 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c2f0-7c8f-43ee-b6a6-8f429c6adb85 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:26.903200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c2f0-7c8f-43ee-b6a6-8f429c6adb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:26.903709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c2f0-7c8f-43ee-b6a6-8f429c6adb85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:26.917038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c2f0-7c8f-43ee-b6a6-8f429c6adb85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:26.918918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c2f0-7c8f-43ee-b6a6-8f429c6adb85 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-73c5c2f0-7c8f-43ee-b6a6-8f429c6adb85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:26.937171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:26.938289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:26.939379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:26.939379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:26.939379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:26.941929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 207/414] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:26.947598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5fc1-28e9-43e6-97e3-4c33d06bd656 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:27.092772 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5fc1-28e9-43e6-97e3-4c33d06bd656 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:27.131131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d0ecf-71e5-4bce-ba8f-fb89ac273a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:27.131773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0ecf-71e5-4bce-ba8f-fb89ac273a9c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:27.132056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0ecf-71e5-4bce-ba8f-fb89ac273a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:27.132333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d0ecf-71e5-4bce-ba8f-fb89ac273a9c None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:27.132980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d0ecf-71e5-4bce-ba8f-fb89ac273a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:27.133286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d0ecf-71e5-4bce-ba8f-fb89ac273a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:27.134657 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d0ecf-71e5-4bce-ba8f-fb89ac273a9c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:27.147315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 208/415] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:27.156777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c2f0-7c8f-43ee-b6a6-8f429c6adb85 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:27.281508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c2f0-7c8f-43ee-b6a6-8f429c6adb85 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:27.294648 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:27.331020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dcdff-a7e1-438c-b29c-0ae190026108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:27.331691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dcdff-a7e1-438c-b29c-0ae190026108 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:27.331967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dcdff-a7e1-438c-b29c-0ae190026108 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:27.332239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dcdff-a7e1-438c-b29c-0ae190026108 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:27.342267 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409dcdff-a7e1-438c-b29c-0ae190026108 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:27.343748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409dcdff-a7e1-438c-b29c-0ae190026108 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-409dcdff-a7e1-438c-b29c-0ae190026108 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:27.358123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:27.358995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:27.359887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:27.359887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:27.359887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:27.359887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:27.359887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:27.359887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:27.359887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:27.359887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:27.363856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 208/416] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:27.366407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d0ecf-71e5-4bce-ba8f-fb89ac273a9c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:27.468437 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:27.518764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d0ecf-71e5-4bce-ba8f-fb89ac273a9c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:27.553427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116e148-6474-41c2-9508-bb45543e701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:27.553955 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116e148-6474-41c2-9508-bb45543e701e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:27.554234 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116e148-6474-41c2-9508-bb45543e701e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:27.554507 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116e148-6474-41c2-9508-bb45543e701e None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:27.555196 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116e148-6474-41c2-9508-bb45543e701e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:27.555526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116e148-6474-41c2-9508-bb45543e701e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:27.556953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116e148-6474-41c2-9508-bb45543e701e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:27.569157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 209/417] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:27.574957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dcdff-a7e1-438c-b29c-0ae190026108 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:27.700020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dcdff-a7e1-438c-b29c-0ae190026108 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:27.748796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16701f9-8da2-4a5f-ad87-2554a7db07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:27.749480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16701f9-8da2-4a5f-ad87-2554a7db07cb None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:27.749822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16701f9-8da2-4a5f-ad87-2554a7db07cb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:27.750102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16701f9-8da2-4a5f-ad87-2554a7db07cb None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/ad7ef5b260e4425c93ebbe85570136db/roles/9551be8340204b80958e4788f306cff6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:27.775860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16701f9-8da2-4a5f-ad87-2554a7db07cb None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=ad7ef5b260e4425c93ebbe85570136db, role_id=9551be8340204b80958e4788f306cff6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:27.777353 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16701f9-8da2-4a5f-ad87-2554a7db07cb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:27.793245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 209/418] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:08:27 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/ad7ef5b260e4425c93ebbe85570136db/roles/9551be8340204b80958e4788f306cff6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:27.880422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f3ebd-3c45-4206-a343-60f8ee9d988e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:27.881058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f3ebd-3c45-4206-a343-60f8ee9d988e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:27.881507 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f3ebd-3c45-4206-a343-60f8ee9d988e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:27.883044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 210/419] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:27.893164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd08ad-2d14-47fd-894e-4e89f496fd8c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:27.893987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd08ad-2d14-47fd-894e-4e89f496fd8c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:27.894266 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd08ad-2d14-47fd-894e-4e89f496fd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:27.917678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-fbfd08ad-2d14-47fd-894e-4e89f496fd8c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:27.918904 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fbfd08ad-2d14-47fd-894e-4e89f496fd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:27.934499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:28.015542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 210/420] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:28.368223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f3ebd-3c45-4206-a343-60f8ee9d988e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:28.479825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f3ebd-3c45-4206-a343-60f8ee9d988e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:28.498637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:28.518775 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea0e13-a563-4fc7-be30-da3b360f4df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:28.519750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea0e13-a563-4fc7-be30-da3b360f4df2 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:28.520225 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea0e13-a563-4fc7-be30-da3b360f4df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:28.520687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea0e13-a563-4fc7-be30-da3b360f4df2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:28.531569 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea0e13-a563-4fc7-be30-da3b360f4df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-b3ea0e13-a563-4fc7-be30-da3b360f4df2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:28.536680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:28.537524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:28.538383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:28.540965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 211/421] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:28.546435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd08ad-2d14-47fd-894e-4e89f496fd8c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:28.699508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd08ad-2d14-47fd-894e-4e89f496fd8c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:28.708590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8e44d-65fd-47d6-83e6-ea21320d5eb6 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:28.709293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8e44d-65fd-47d6-83e6-ea21320d5eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:28.709640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8e44d-65fd-47d6-83e6-ea21320d5eb6 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:28.714495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 212/422] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:28.725315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a94eb-3db4-4d61-a903-e40fafcc42bf None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:28.725674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a94eb-3db4-4d61-a903-e40fafcc42bf None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:28.726021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a94eb-3db4-4d61-a903-e40fafcc42bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:28.739180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651570c5-56b0-4ff6-b8a4-3296f2494172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:28.740278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651570c5-56b0-4ff6-b8a4-3296f2494172 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:28.740727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651570c5-56b0-4ff6-b8a4-3296f2494172 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:28.741150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651570c5-56b0-4ff6-b8a4-3296f2494172 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:28.741957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651570c5-56b0-4ff6-b8a4-3296f2494172 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:28.742397 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651570c5-56b0-4ff6-b8a4-3296f2494172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:28.743950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651570c5-56b0-4ff6-b8a4-3296f2494172 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:28.753389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 211/423] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:28.759056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651570c5-56b0-4ff6-b8a4-3296f2494172 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:28.762769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fe3a94eb-3db4-4d61-a903-e40fafcc42bf None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:28.765816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fe3a94eb-3db4-4d61-a903-e40fafcc42bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:28.780916 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:28.869582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 213/424] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:08:28.917154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651570c5-56b0-4ff6-b8a4-3296f2494172 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:28.952359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d50b1f-a5eb-420e-9416-1cf85b944fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:28.953205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d50b1f-a5eb-420e-9416-1cf85b944fed None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:28.953624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d50b1f-a5eb-420e-9416-1cf85b944fed None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:28.954063 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d50b1f-a5eb-420e-9416-1cf85b944fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:28.969142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d50b1f-a5eb-420e-9416-1cf85b944fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:28.970811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d50b1f-a5eb-420e-9416-1cf85b944fed None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-21d50b1f-a5eb-420e-9416-1cf85b944fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:28.992015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:28.993150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:28.994201 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:28.994201 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:28.994201 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:28.996024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 212/425] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:29.001901 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a94eb-3db4-4d61-a903-e40fafcc42bf None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:29.156312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a94eb-3db4-4d61-a903-e40fafcc42bf None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:29.169231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:29.199696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d50b1f-a5eb-420e-9416-1cf85b944fed None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:29.205557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7ccb4-f497-4e7d-bcd9-c207c335941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:29.206141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7ccb4-f497-4e7d-bcd9-c207c335941f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:29.206424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7ccb4-f497-4e7d-bcd9-c207c335941f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:29.206700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7ccb4-f497-4e7d-bcd9-c207c335941f None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:29.207386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7ccb4-f497-4e7d-bcd9-c207c335941f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:29.207691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7ccb4-f497-4e7d-bcd9-c207c335941f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:29.209130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7ccb4-f497-4e7d-bcd9-c207c335941f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:29.228102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 214/426] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:29.233389 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7ccb4-f497-4e7d-bcd9-c207c335941f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:29.267234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:29.322810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d50b1f-a5eb-420e-9416-1cf85b944fed None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:29.395908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9f5a-7174-4821-83fc-8c28c8be8b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:29.396541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9f5a-7174-4821-83fc-8c28c8be8b96 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:29.396820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9f5a-7174-4821-83fc-8c28c8be8b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:29.397094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9f5a-7174-4821-83fc-8c28c8be8b96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:29.415950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9f5a-7174-4821-83fc-8c28c8be8b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-59db9f5a-7174-4821-83fc-8c28c8be8b96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:29.421219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:29.422120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:29.423391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 213/427] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:29.426289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7ccb4-f497-4e7d-bcd9-c207c335941f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:29.428744 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9f5a-7174-4821-83fc-8c28c8be8b96 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:29.487152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2173bf7-04a3-4936-be1d-667c635661e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:29.487723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2173bf7-04a3-4936-be1d-667c635661e5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:29.488000 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2173bf7-04a3-4936-be1d-667c635661e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:29.488272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2173bf7-04a3-4936-be1d-667c635661e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:29.503855 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2173bf7-04a3-4936-be1d-667c635661e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:29.505480 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2173bf7-04a3-4936-be1d-667c635661e5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-b2173bf7-04a3-4936-be1d-667c635661e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:29.523181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:29.524156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:29.525678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 215/428] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 21 21:08:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:29.531290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2173bf7-04a3-4936-be1d-667c635661e5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:29.563817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:29.639496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9f5a-7174-4821-83fc-8c28c8be8b96 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:29.685581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2173bf7-04a3-4936-be1d-667c635661e5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:29.691714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:29.714779 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f4c15-6284-4cd0-b383-995459236593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:29.715443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f4c15-6284-4cd0-b383-995459236593 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:29.715778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f4c15-6284-4cd0-b383-995459236593 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:29.719295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f4c15-6284-4cd0-b383-995459236593 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:29.719295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f4c15-6284-4cd0-b383-995459236593 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:29.719295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f4c15-6284-4cd0-b383-995459236593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:29.719295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f4c15-6284-4cd0-b383-995459236593 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:29.727951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 214/429] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:29.729337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1e0bd-981f-4fdf-81c3-09e9889cd528 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:29.729627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1e0bd-981f-4fdf-81c3-09e9889cd528 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:29.730006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1e0bd-981f-4fdf-81c3-09e9889cd528 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:29.731525 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 215/430] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:29.732893 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1e0bd-981f-4fdf-81c3-09e9889cd528 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:29.744921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5aac85-2735-44fa-ba06-c3266a3a6c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:29.745469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aac85-2735-44fa-ba06-c3266a3a6c0d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:29.745749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aac85-2735-44fa-ba06-c3266a3a6c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:29.746020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aac85-2735-44fa-ba06-c3266a3a6c0d None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:29.747223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5aac85-2735-44fa-ba06-c3266a3a6c0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:29.747563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5aac85-2735-44fa-ba06-c3266a3a6c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:29.749372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5aac85-2735-44fa-ba06-c3266a3a6c0d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:29.772772 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 216/431] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 21 21:08:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:29.775868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b80f44-17ff-44e0-a7e4-7f782fd5933d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:29.776155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b80f44-17ff-44e0-a7e4-7f782fd5933d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:29.776435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b80f44-17ff-44e0-a7e4-7f782fd5933d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:29.799978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-99b80f44-17ff-44e0-a7e4-7f782fd5933d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:29.801594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-99b80f44-17ff-44e0-a7e4-7f782fd5933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:29.850611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1e0bd-981f-4fdf-81c3-09e9889cd528 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:29.872757 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 217/432] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:29.873821 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd416df-1e08-4b42-94bd-21d40bde8c22 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:29.874105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd416df-1e08-4b42-94bd-21d40bde8c22 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:29.874380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd416df-1e08-4b42-94bd-21d40bde8c22 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:29.880555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 218/433] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:29.880555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd416df-1e08-4b42-94bd-21d40bde8c22 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:29.900942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a72a4-be4b-452b-a9dd-90be4bfa890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:29.901521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a72a4-be4b-452b-a9dd-90be4bfa890e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:29.901899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a72a4-be4b-452b-a9dd-90be4bfa890e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:29.902345 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a72a4-be4b-452b-a9dd-90be4bfa890e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:29.909460 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:29.914907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a72a4-be4b-452b-a9dd-90be4bfa890e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:29.917145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a72a4-be4b-452b-a9dd-90be4bfa890e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-2b2a72a4-be4b-452b-a9dd-90be4bfa890e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:29.933249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:29.934256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:29.935114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:29.935114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:29.935114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:29.939103 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 216/434] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:29.941149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609dc7b-b1a1-43c5-b8f7-ae579e2102bb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:29.941429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609dc7b-b1a1-43c5-b8f7-ae579e2102bb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:29.941811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609dc7b-b1a1-43c5-b8f7-ae579e2102bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:29.961640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f609dc7b-b1a1-43c5-b8f7-ae579e2102bb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:29.962764 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f609dc7b-b1a1-43c5-b8f7-ae579e2102bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:29.994368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:30.025200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd416df-1e08-4b42-94bd-21d40bde8c22 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:30.047305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 217/435] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:30.047305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609dc7b-b1a1-43c5-b8f7-ae579e2102bb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:30.102495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad386965-8909-446b-9b13-1124fd3c02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:30.103104 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad386965-8909-446b-9b13-1124fd3c02ea None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.103443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad386965-8909-446b-9b13-1124fd3c02ea None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.103717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad386965-8909-446b-9b13-1124fd3c02ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.200943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad386965-8909-446b-9b13-1124fd3c02ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:30.202443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad386965-8909-446b-9b13-1124fd3c02ea None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:30.216452 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609dc7b-b1a1-43c5-b8f7-ae579e2102bb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:30.220872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:30.268738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21fb1-6c53-44f6-8a1e-8d27d695a440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:30.269352 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21fb1-6c53-44f6-8a1e-8d27d695a440 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.269631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21fb1-6c53-44f6-8a1e-8d27d695a440 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.269903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21fb1-6c53-44f6-8a1e-8d27d695a440 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.270542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e21fb1-6c53-44f6-8a1e-8d27d695a440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:30.270842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e21fb1-6c53-44f6-8a1e-8d27d695a440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:30.272264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e21fb1-6c53-44f6-8a1e-8d27d695a440 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:30.284121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 218/436] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:30.284725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21fb1-6c53-44f6-8a1e-8d27d695a440 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:30.317563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:30.329510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 219/437] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:08:30.330700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad386965-8909-446b-9b13-1124fd3c02ea None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:30.395692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21fb1-6c53-44f6-8a1e-8d27d695a440 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:30.434033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106de93-9966-4a74-8010-be47d0e9fd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:30.434671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106de93-9966-4a74-8010-be47d0e9fd36 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.434953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106de93-9966-4a74-8010-be47d0e9fd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.435227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106de93-9966-4a74-8010-be47d0e9fd36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.442522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad386965-8909-446b-9b13-1124fd3c02ea None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:30.445686 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106de93-9966-4a74-8010-be47d0e9fd36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-5106de93-9966-4a74-8010-be47d0e9fd36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:30.451224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:30.452126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:30.452911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 219/438] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:30.453568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106de93-9966-4a74-8010-be47d0e9fd36 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:30.465417 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:30.485253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e825e-ce7d-453f-ab42-bf307890c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:30.485909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e825e-ce7d-453f-ab42-bf307890c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.486193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e825e-ce7d-453f-ab42-bf307890c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.486465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e825e-ce7d-453f-ab42-bf307890c0a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.496512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e825e-ce7d-453f-ab42-bf307890c0a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:30.497996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e825e-ce7d-453f-ab42-bf307890c0a3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-128e825e-ce7d-453f-ab42-bf307890c0a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:30.511636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:30.512658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:30.513566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 220/439] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:08:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:30.518211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e825e-ce7d-453f-ab42-bf307890c0a3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:30.553683 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:30.568447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106de93-9966-4a74-8010-be47d0e9fd36 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:30.602593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c90b9-6f81-4a61-80de-8cdfcc207969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:30.603229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c90b9-6f81-4a61-80de-8cdfcc207969 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.603542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c90b9-6f81-4a61-80de-8cdfcc207969 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.603820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c90b9-6f81-4a61-80de-8cdfcc207969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.614653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c90b9-6f81-4a61-80de-8cdfcc207969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:30.616133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c90b9-6f81-4a61-80de-8cdfcc207969 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:30.624667 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e825e-ce7d-453f-ab42-bf307890c0a3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-ad6c90b9-6f81-4a61-80de-8cdfcc207969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:30.630443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:30.631519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:30.632427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:30.632427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:30.632427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:30.633067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 220/440] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:30.633869 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c90b9-6f81-4a61-80de-8cdfcc207969 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:30.658828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a842b8-6e00-4059-a710-0cf0d7ba9ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:30.659485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a842b8-6e00-4059-a710-0cf0d7ba9ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.659768 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a842b8-6e00-4059-a710-0cf0d7ba9ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.660040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a842b8-6e00-4059-a710-0cf0d7ba9ae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.670020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a842b8-6e00-4059-a710-0cf0d7ba9ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-46a842b8-6e00-4059-a710-0cf0d7ba9ae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:30.675321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:30.676458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 221/441] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:30.677274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a842b8-6e00-4059-a710-0cf0d7ba9ae9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:30.712243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:30.736770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c90b9-6f81-4a61-80de-8cdfcc207969 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:30.770240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52677d-134e-44a8-8e4a-eb4e47115e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:30.770844 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52677d-134e-44a8-8e4a-eb4e47115e66 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.771124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52677d-134e-44a8-8e4a-eb4e47115e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.771427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52677d-134e-44a8-8e4a-eb4e47115e66 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.772085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52677d-134e-44a8-8e4a-eb4e47115e66 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:30.772387 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52677d-134e-44a8-8e4a-eb4e47115e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:30.773736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52677d-134e-44a8-8e4a-eb4e47115e66 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:30.775740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a842b8-6e00-4059-a710-0cf0d7ba9ae9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:30.779588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:30.788489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 221/442] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:30.788489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe007-c20b-4a88-a9c4-3b0c3e18f698 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.788489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe007-c20b-4a88-a9c4-3b0c3e18f698 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.788489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe007-c20b-4a88-a9c4-3b0c3e18f698 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.788489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 222/443] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:30.789076 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe007-c20b-4a88-a9c4-3b0c3e18f698 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:30.812272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8cf75-a78f-4d47-986a-a3b05e20fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:30.812806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8cf75-a78f-4d47-986a-a3b05e20fa13 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.813083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8cf75-a78f-4d47-986a-a3b05e20fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.813356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8cf75-a78f-4d47-986a-a3b05e20fa13 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.814084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8cf75-a78f-4d47-986a-a3b05e20fa13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:30.814387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8cf75-a78f-4d47-986a-a3b05e20fa13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:30.816401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8cf75-a78f-4d47-986a-a3b05e20fa13 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:30.833870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 222/444] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 21 21:08:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:30.834652 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8cf75-a78f-4d47-986a-a3b05e20fa13 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:30.891566 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe007-c20b-4a88-a9c4-3b0c3e18f698 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:30.923385 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a756050-e516-485d-806a-b73614f8f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:30.923996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a756050-e516-485d-806a-b73614f8f574 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.924277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a756050-e516-485d-806a-b73614f8f574 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.925057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a756050-e516-485d-806a-b73614f8f574 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.925697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a756050-e516-485d-806a-b73614f8f574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:30.926005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a756050-e516-485d-806a-b73614f8f574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:30.926539 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:30.927391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a756050-e516-485d-806a-b73614f8f574 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:30.933436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8cf75-a78f-4d47-986a-a3b05e20fa13 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:30.938604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 223/445] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:30.939414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a756050-e516-485d-806a-b73614f8f574 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:30.970350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4350c-dad8-4056-8c97-2336aaf422fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:30.970959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4350c-dad8-4056-8c97-2336aaf422fb None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.971239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4350c-dad8-4056-8c97-2336aaf422fb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.971581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4350c-dad8-4056-8c97-2336aaf422fb None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.972245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4350c-dad8-4056-8c97-2336aaf422fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:30.972552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4350c-dad8-4056-8c97-2336aaf422fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:30.973929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4350c-dad8-4056-8c97-2336aaf422fb None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:30.981627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 223/446] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:30.982759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb5ec4-3589-4ddf-91d5-10e81b62cf9a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:30.983047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb5ec4-3589-4ddf-91d5-10e81b62cf9a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:30.983355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb5ec4-3589-4ddf-91d5-10e81b62cf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:30.999695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:31.001674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-99eb5ec4-3589-4ddf-91d5-10e81b62cf9a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:31.003446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-99eb5ec4-3589-4ddf-91d5-10e81b62cf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:31.040588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a756050-e516-485d-806a-b73614f8f574 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.069856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 224/447] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:31.070627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb5ec4-3589-4ddf-91d5-10e81b62cf9a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.077129 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f53b8-da0e-4f34-99f8-2eed2308a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.077760 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f53b8-da0e-4f34-99f8-2eed2308a56d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.078042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f53b8-da0e-4f34-99f8-2eed2308a56d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.078319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f53b8-da0e-4f34-99f8-2eed2308a56d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.089503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f53b8-da0e-4f34-99f8-2eed2308a56d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:31.090968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f53b8-da0e-4f34-99f8-2eed2308a56d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-bb2f53b8-da0e-4f34-99f8-2eed2308a56d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:31.105817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:31.106728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:31.107625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:31.107625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:31.107625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:31.107625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 224/448] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:31.107845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f53b8-da0e-4f34-99f8-2eed2308a56d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.173991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:31.189822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb5ec4-3589-4ddf-91d5-10e81b62cf9a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.221803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f53b8-da0e-4f34-99f8-2eed2308a56d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.224887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac89116-2a03-4537-9588-f07d836c545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.225520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac89116-2a03-4537-9588-f07d836c545f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.225803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac89116-2a03-4537-9588-f07d836c545f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.226078 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac89116-2a03-4537-9588-f07d836c545f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.234499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:31.237709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac89116-2a03-4537-9588-f07d836c545f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:31.239340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac89116-2a03-4537-9588-f07d836c545f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-2ac89116-2a03-4537-9588-f07d836c545f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:31.254508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:31.255621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:31.256620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:31.256620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:31.256620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:31.256620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 225/449] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:31.256832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac89116-2a03-4537-9588-f07d836c545f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.262463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7c34b-a2bb-4491-9bfe-9a108a1e477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.263294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7c34b-a2bb-4491-9bfe-9a108a1e477d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.263675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7c34b-a2bb-4491-9bfe-9a108a1e477d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.263950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7c34b-a2bb-4491-9bfe-9a108a1e477d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.270676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7c34b-a2bb-4491-9bfe-9a108a1e477d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:31.272138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7c34b-a2bb-4491-9bfe-9a108a1e477d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-cdd7c34b-a2bb-4491-9bfe-9a108a1e477d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:31.283118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:31.284514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:31.285360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:31.285360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:31.285360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:31.285360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:31.285360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:31.285360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:31.285360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:31.285360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:31.285360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 225/450] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:31.285841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7c34b-a2bb-4491-9bfe-9a108a1e477d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.368769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac89116-2a03-4537-9588-f07d836c545f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.386252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7c34b-a2bb-4491-9bfe-9a108a1e477d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.402780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54431d-8228-4fa9-9889-e4820ff72e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.403438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54431d-8228-4fa9-9889-e4820ff72e8d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.403723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54431d-8228-4fa9-9889-e4820ff72e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.403998 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54431d-8228-4fa9-9889-e4820ff72e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.411440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:31.416023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54431d-8228-4fa9-9889-e4820ff72e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:31.417482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54431d-8228-4fa9-9889-e4820ff72e8d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:31.418802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d632-c61c-437c-88e2-9b0df110f2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.419430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d632-c61c-437c-88e2-9b0df110f2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.419709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d632-c61c-437c-88e2-9b0df110f2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.419977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d632-c61c-437c-88e2-9b0df110f2f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.420603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92d632-c61c-437c-88e2-9b0df110f2f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:31.420901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92d632-c61c-437c-88e2-9b0df110f2f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:31.422229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92d632-c61c-437c-88e2-9b0df110f2f5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-4e54431d-8228-4fa9-9889-e4820ff72e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:31.432236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:31.433181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:31.434027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:31.434027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:31.434027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:31.434027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 226/451] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:31.434238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54431d-8228-4fa9-9889-e4820ff72e8d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.439044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 226/452] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:31.439044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d632-c61c-437c-88e2-9b0df110f2f5 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.466658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:31.533536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d632-c61c-437c-88e2-9b0df110f2f5 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.533710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54431d-8228-4fa9-9889-e4820ff72e8d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.567450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc07f7b-349e-45ad-a82c-baf7d230dcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.568058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc07f7b-349e-45ad-a82c-baf7d230dcf4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.568339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc07f7b-349e-45ad-a82c-baf7d230dcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.568615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc07f7b-349e-45ad-a82c-baf7d230dcf4 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.569120 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119165-de34-4b1c-85fa-56610c6c6084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.569301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc07f7b-349e-45ad-a82c-baf7d230dcf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:31.569607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc07f7b-349e-45ad-a82c-baf7d230dcf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:31.569727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119165-de34-4b1c-85fa-56610c6c6084 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.570004 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119165-de34-4b1c-85fa-56610c6c6084 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.570273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119165-de34-4b1c-85fa-56610c6c6084 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.570961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119165-de34-4b1c-85fa-56610c6c6084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:31.571055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc07f7b-349e-45ad-a82c-baf7d230dcf4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:31.571262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119165-de34-4b1c-85fa-56610c6c6084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:31.572647 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119165-de34-4b1c-85fa-56610c6c6084 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:31.583094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 227/453] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:31.583916 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc07f7b-349e-45ad-a82c-baf7d230dcf4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.584877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 227/454] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:31.585568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119165-de34-4b1c-85fa-56610c6c6084 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.633603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:31.673886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:31.683334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119165-de34-4b1c-85fa-56610c6c6084 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.683471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc07f7b-349e-45ad-a82c-baf7d230dcf4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.716550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fdb90-92c5-455b-9d2d-cfdf173d29f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.716767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e21b8-fabc-41a9-9be2-5903fdef5d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.717178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fdb90-92c5-455b-9d2d-cfdf173d29f9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.717361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e21b8-fabc-41a9-9be2-5903fdef5d57 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.717470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fdb90-92c5-455b-9d2d-cfdf173d29f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.717635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e21b8-fabc-41a9-9be2-5903fdef5d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.717724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fdb90-92c5-455b-9d2d-cfdf173d29f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.717901 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e21b8-fabc-41a9-9be2-5903fdef5d57 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.718534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e21b8-fabc-41a9-9be2-5903fdef5d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:31.718827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e21b8-fabc-41a9-9be2-5903fdef5d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:31.720217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e21b8-fabc-41a9-9be2-5903fdef5d57 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:31.728694 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fdb90-92c5-455b-9d2d-cfdf173d29f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:31.731593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 228/455] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:31.732363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e21b8-fabc-41a9-9be2-5903fdef5d57 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-bd0fdb90-92c5-455b-9d2d-cfdf173d29f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:31.734004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:31.734874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 228/456] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:31.736044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fdb90-92c5-455b-9d2d-cfdf173d29f9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.837235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fdb90-92c5-455b-9d2d-cfdf173d29f9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.837876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e21b8-fabc-41a9-9be2-5903fdef5d57 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:31.848996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:31.870219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542773c-05a5-45fb-ae3b-f1190b598fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.870819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542773c-05a5-45fb-ae3b-f1190b598fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.871105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542773c-05a5-45fb-ae3b-f1190b598fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.871430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542773c-05a5-45fb-ae3b-f1190b598fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.871700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad811e7-db6b-4a44-8e72-aa3a104e2551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:31.872153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542773c-05a5-45fb-ae3b-f1190b598fc7 None admin] RBAC: Adding query filter params (role.id=9551be8340204b80958e4788f306cff6, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=8afe54a4c63b4a50a6240293e2be6450) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:31.872325 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad811e7-db6b-4a44-8e72-aa3a104e2551 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:31.872463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542773c-05a5-45fb-ae3b-f1190b598fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:31.872608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad811e7-db6b-4a44-8e72-aa3a104e2551 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:31.872886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad811e7-db6b-4a44-8e72-aa3a104e2551 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:31.873910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542773c-05a5-45fb-ae3b-f1190b598fc7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:31.883601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 229/457] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/role_assignments?user.id=8afe54a4c63b4a50a6240293e2be6450&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=9551be8340204b80958e4788f306cff6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:31.883795 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad811e7-db6b-4a44-8e72-aa3a104e2551 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:31.883890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542773c-05a5-45fb-ae3b-f1190b598fc7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.883986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad811e7-db6b-4a44-8e72-aa3a104e2551 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-1ad811e7-db6b-4a44-8e72-aa3a104e2551 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:31.896557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:31.897686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:31.898703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 229/458] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:31.899381 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad811e7-db6b-4a44-8e72-aa3a104e2551 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:31.920993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:32.012454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542773c-05a5-45fb-ae3b-f1190b598fc7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.020435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad811e7-db6b-4a44-8e72-aa3a104e2551 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.057298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2554f3-e5d7-4d25-b4d0-4efca52981b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.057947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2554f3-e5d7-4d25-b4d0-4efca52981b1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.058520 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2554f3-e5d7-4d25-b4d0-4efca52981b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.058520 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2554f3-e5d7-4d25-b4d0-4efca52981b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.064800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a93d70-f60e-47fb-ab50-d2ff9eca6cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.065226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93d70-f60e-47fb-ab50-d2ff9eca6cab None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.065505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93d70-f60e-47fb-ab50-d2ff9eca6cab None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.065780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93d70-f60e-47fb-ab50-d2ff9eca6cab None admin] PATH_INFO: `/v3/users/glance` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.066858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2554f3-e5d7-4d25-b4d0-4efca52981b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:32.069073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2554f3-e5d7-4d25-b4d0-4efca52981b1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:32.076324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a93d70-f60e-47fb-ab50-d2ff9eca6cab None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:32.077766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a93d70-f60e-47fb-ab50-d2ff9eca6cab None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-cb2554f3-e5d7-4d25-b4d0-4efca52981b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:32.082521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:32.083446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:32.084308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:32.084308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:32.084308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:32.084308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:32.084308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:32.084308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:32.084308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:32.084308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:32.084308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 230/459] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:32.084937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2554f3-e5d7-4d25-b4d0-4efca52981b1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-29a93d70-f60e-47fb-ab50-d2ff9eca6cab None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:32.091561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:32.092455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:32.093340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 230/460] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:32.093893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a93d70-f60e-47fb-ab50-d2ff9eca6cab None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:32.130861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:32.167831 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:32.192446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2554f3-e5d7-4d25-b4d0-4efca52981b1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.205434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a93d70-f60e-47fb-ab50-d2ff9eca6cab None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.228865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced17f3-fd8f-4938-991d-4d75386d1083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.229469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced17f3-fd8f-4938-991d-4d75386d1083 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.229749 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced17f3-fd8f-4938-991d-4d75386d1083 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.230019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced17f3-fd8f-4938-991d-4d75386d1083 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.230675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced17f3-fd8f-4938-991d-4d75386d1083 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:32.230972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced17f3-fd8f-4938-991d-4d75386d1083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:32.232360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced17f3-fd8f-4938-991d-4d75386d1083 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:32.241035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 231/461] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:32.241833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced17f3-fd8f-4938-991d-4d75386d1083 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:32.247245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d6255-6dff-49b5-85aa-7249406be5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.247927 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d6255-6dff-49b5-85aa-7249406be5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.248210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d6255-6dff-49b5-85aa-7249406be5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.248484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d6255-6dff-49b5-85aa-7249406be5b3 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.249219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d6255-6dff-49b5-85aa-7249406be5b3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:32.249523 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d6255-6dff-49b5-85aa-7249406be5b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:32.250945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d6255-6dff-49b5-85aa-7249406be5b3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:32.271882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 231/462] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Oct 21 21:08:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:32.272721 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d6255-6dff-49b5-85aa-7249406be5b3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:32.356022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced17f3-fd8f-4938-991d-4d75386d1083 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.364890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:32.377972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d6255-6dff-49b5-85aa-7249406be5b3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.395093 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc9333-419e-4d82-b1fc-15377a12a170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.395750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc9333-419e-4d82-b1fc-15377a12a170 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.396025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc9333-419e-4d82-b1fc-15377a12a170 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.396294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc9333-419e-4d82-b1fc-15377a12a170 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.396988 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc9333-419e-4d82-b1fc-15377a12a170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:32.397290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc9333-419e-4d82-b1fc-15377a12a170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:32.398776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc9333-419e-4d82-b1fc-15377a12a170 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:32.408306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:32.414404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba6d55-35b4-431b-b883-66efc94daa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.415014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba6d55-35b4-431b-b883-66efc94daa07 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.415308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba6d55-35b4-431b-b883-66efc94daa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.415592 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba6d55-35b4-431b-b883-66efc94daa07 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.416316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba6d55-35b4-431b-b883-66efc94daa07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:32.416619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba6d55-35b4-431b-b883-66efc94daa07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:32.417346 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 232/463] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:32.418081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba6d55-35b4-431b-b883-66efc94daa07 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:32.418247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc9333-419e-4d82-b1fc-15377a12a170 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:32.439314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 232/464] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Oct 21 21:08:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:32.439314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba6d55-35b4-431b-b883-66efc94daa07 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:32.524307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc9333-419e-4d82-b1fc-15377a12a170 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.547345 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba6d55-35b4-431b-b883-66efc94daa07 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.559259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa16d99-2e7a-4f5c-ae75-d067674f00a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.559912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa16d99-2e7a-4f5c-ae75-d067674f00a2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.560189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa16d99-2e7a-4f5c-ae75-d067674f00a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.560458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa16d99-2e7a-4f5c-ae75-d067674f00a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.571211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa16d99-2e7a-4f5c-ae75-d067674f00a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:32.572677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa16d99-2e7a-4f5c-ae75-d067674f00a2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:32.584523 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511cef4-da86-48ec-9151-ad88bf97caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.585131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511cef4-da86-48ec-9151-ad88bf97caaf None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.585413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511cef4-da86-48ec-9151-ad88bf97caaf None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.585685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511cef4-da86-48ec-9151-ad88bf97caaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-8fa16d99-2e7a-4f5c-ae75-d067674f00a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:32.588123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:32.588999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:32.589837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:32.589837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:32.589837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:32.589837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 233/465] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:32.590057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa16d99-2e7a-4f5c-ae75-d067674f00a2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:32.605630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:32.642011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:32.668396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511cef4-da86-48ec-9151-ad88bf97caaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:32.669771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511cef4-da86-48ec-9151-ad88bf97caaf None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:32.700836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa16d99-2e7a-4f5c-ae75-d067674f00a2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.737443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9fc61-8e04-4124-b30e-6ff3410583ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.738097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9fc61-8e04-4124-b30e-6ff3410583ef None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.738420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9fc61-8e04-4124-b30e-6ff3410583ef None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.738662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9fc61-8e04-4124-b30e-6ff3410583ef None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/e2dc36f09ae941ecbf30ff11475e7f74/roles/9551be8340204b80958e4788f306cff6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.754556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9fc61-8e04-4124-b30e-6ff3410583ef None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=e2dc36f09ae941ecbf30ff11475e7f74, role_id=9551be8340204b80958e4788f306cff6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:32.756049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9fc61-8e04-4124-b30e-6ff3410583ef None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:32.779307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 234/466] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:08:32 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/e2dc36f09ae941ecbf30ff11475e7f74/roles/9551be8340204b80958e4788f306cff6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:32.779307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9fc61-8e04-4124-b30e-6ff3410583ef None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:32.790632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 233/467] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:08:32.796396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511cef4-da86-48ec-9151-ad88bf97caaf None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:32.857014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:32.923870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:32.928937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511cef4-da86-48ec-9151-ad88bf97caaf None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.930218 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9fc61-8e04-4124-b30e-6ff3410583ef None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:32.974723 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359868c1-618b-4009-b051-e8fec2eafae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.975390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359868c1-618b-4009-b051-e8fec2eafae3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.975677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359868c1-618b-4009-b051-e8fec2eafae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.975955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359868c1-618b-4009-b051-e8fec2eafae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.977639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fafe1-e23c-41ab-a87d-193b50d4d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:32.978669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fafe1-e23c-41ab-a87d-193b50d4d191 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:32.979159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fafe1-e23c-41ab-a87d-193b50d4d191 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:32.979642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fafe1-e23c-41ab-a87d-193b50d4d191 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:32.980484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fafe1-e23c-41ab-a87d-193b50d4d191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:32.980950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fafe1-e23c-41ab-a87d-193b50d4d191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:32.982495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fafe1-e23c-41ab-a87d-193b50d4d191 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:32.997021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 234/468] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:32.998262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fafe1-e23c-41ab-a87d-193b50d4d191 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:33.047219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359868c1-618b-4009-b051-e8fec2eafae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:33.049323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359868c1-618b-4009-b051-e8fec2eafae3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:33.119001 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fafe1-e23c-41ab-a87d-193b50d4d191 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:33.127694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:33.161419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9410e-fdea-4e3c-8363-633ff22c4cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:33.162121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9410e-fdea-4e3c-8363-633ff22c4cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:33.162409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9410e-fdea-4e3c-8363-633ff22c4cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:33.162688 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9410e-fdea-4e3c-8363-633ff22c4cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:33.174319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:33.177067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9410e-fdea-4e3c-8363-633ff22c4cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:33.179009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 235/469] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:08:33.180202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359868c1-618b-4009-b051-e8fec2eafae3 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:33.183986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9410e-fdea-4e3c-8363-633ff22c4cb7 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-75a9410e-fdea-4e3c-8363-633ff22c4cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:33.202678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:33.203619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:33.204796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:33.204796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:33.204796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:33.204796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 235/470] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:33.205188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9410e-fdea-4e3c-8363-633ff22c4cb7 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:33.297622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359868c1-618b-4009-b051-e8fec2eafae3 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:33.329892 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9410e-fdea-4e3c-8363-633ff22c4cb7 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:33.346170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16fa9f-28bf-4946-8dc6-0827783d6e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:33.347987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16fa9f-28bf-4946-8dc6-0827783d6e53 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:33.348484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16fa9f-28bf-4946-8dc6-0827783d6e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:33.349185 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16fa9f-28bf-4946-8dc6-0827783d6e53 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:33.358975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16fa9f-28bf-4946-8dc6-0827783d6e53 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:33.361303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16fa9f-28bf-4946-8dc6-0827783d6e53 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:33.367967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd8b97-0df8-4f67-b878-7c107ed75eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:33.368598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd8b97-0df8-4f67-b878-7c107ed75eda None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:33.368876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd8b97-0df8-4f67-b878-7c107ed75eda None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:33.369150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd8b97-0df8-4f67-b878-7c107ed75eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-8a16fa9f-28bf-4946-8dc6-0827783d6e53 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:33.378714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:33.379652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:33.380532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 236/471] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:33.386699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16fa9f-28bf-4946-8dc6-0827783d6e53 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:33.389723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd8b97-0df8-4f67-b878-7c107ed75eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:33.391180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd8b97-0df8-4f67-b878-7c107ed75eda None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-eabd8b97-0df8-4f67-b878-7c107ed75eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:33.410530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:33.411748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:33.412576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:33.412576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:33.412576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:33.415124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 236/472] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:33.416255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd8b97-0df8-4f67-b878-7c107ed75eda None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:33.431191 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:33.451650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:33.494732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16fa9f-28bf-4946-8dc6-0827783d6e53 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:33.531322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d212-50fc-4399-8d8f-4e36cb16d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:33.531921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d212-50fc-4399-8d8f-4e36cb16d320 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:33.532202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d212-50fc-4399-8d8f-4e36cb16d320 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:33.532476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d212-50fc-4399-8d8f-4e36cb16d320 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:33.533280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d212-50fc-4399-8d8f-4e36cb16d320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:33.533488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d212-50fc-4399-8d8f-4e36cb16d320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:33.534944 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d212-50fc-4399-8d8f-4e36cb16d320 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:33.536652 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd8b97-0df8-4f67-b878-7c107ed75eda None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:33.552781 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 237/473] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:33.553738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d212-50fc-4399-8d8f-4e36cb16d320 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:33.576946 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a0d34-017e-40da-832a-2b973083298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:33.578426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a0d34-017e-40da-832a-2b973083298c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:33.578874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a0d34-017e-40da-832a-2b973083298c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:33.579335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a0d34-017e-40da-832a-2b973083298c None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:33.580330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a0d34-017e-40da-832a-2b973083298c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:33.581398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a0d34-017e-40da-832a-2b973083298c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:33.583205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a0d34-017e-40da-832a-2b973083298c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:33.608771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 237/474] 10.222.0.23 () {56 vars in 1139 bytes} [Fri Oct 21 21:08:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:33.608771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a0d34-017e-40da-832a-2b973083298c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:33.662512 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d212-50fc-4399-8d8f-4e36cb16d320 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:33.684125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:33.691809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:33.708408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e2e99-8443-47cb-92d5-28987ebfd76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:33.709736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e2e99-8443-47cb-92d5-28987ebfd76f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:33.710210 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e2e99-8443-47cb-92d5-28987ebfd76f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:33.710811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e2e99-8443-47cb-92d5-28987ebfd76f None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:33.711837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e2e99-8443-47cb-92d5-28987ebfd76f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:33.712732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e2e99-8443-47cb-92d5-28987ebfd76f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:33.714591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e2e99-8443-47cb-92d5-28987ebfd76f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:33.729574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 238/475] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:33.731232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e2e99-8443-47cb-92d5-28987ebfd76f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:33.733535 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a0d34-017e-40da-832a-2b973083298c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:33.776846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12de88b-8e55-4c71-a467-fb43371a1198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:33.777488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12de88b-8e55-4c71-a467-fb43371a1198 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:33.777767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12de88b-8e55-4c71-a467-fb43371a1198 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:33.778045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12de88b-8e55-4c71-a467-fb43371a1198 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:33.786121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12de88b-8e55-4c71-a467-fb43371a1198 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:33.787707 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12de88b-8e55-4c71-a467-fb43371a1198 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-a12de88b-8e55-4c71-a467-fb43371a1198 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:33.801980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:33.802838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:33.803691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:33.803691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:33.803691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:33.803691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:33.803691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:33.803691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:33.803691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:33.803691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:33.807543 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 238/476] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:33.808390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12de88b-8e55-4c71-a467-fb43371a1198 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:33.859195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e2e99-8443-47cb-92d5-28987ebfd76f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:33.906986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626c4a8-2b09-421d-8b75-41decb50a794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:33.908181 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626c4a8-2b09-421d-8b75-41decb50a794 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:33.909587 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626c4a8-2b09-421d-8b75-41decb50a794 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:33.910402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626c4a8-2b09-421d-8b75-41decb50a794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:33.930155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12de88b-8e55-4c71-a467-fb43371a1198 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:33.961673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:33.973249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43fd5-2c5a-4bd5-b0c3-3d60821a9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:33.973942 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43fd5-2c5a-4bd5-b0c3-3d60821a9c38 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:33.974219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43fd5-2c5a-4bd5-b0c3-3d60821a9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:33.974491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43fd5-2c5a-4bd5-b0c3-3d60821a9c38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:33.978724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:33.987646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d43fd5-2c5a-4bd5-b0c3-3d60821a9c38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:33.989353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d43fd5-2c5a-4bd5-b0c3-3d60821a9c38 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:34.003503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626c4a8-2b09-421d-8b75-41decb50a794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-e8d43fd5-2c5a-4bd5-b0c3-3d60821a9c38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:34.004088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:34.004871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:34.005709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:34.005709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:34.005709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:34.005709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:34.005709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:34.005709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:34.005709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:34.005709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:34.006112 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626c4a8-2b09-421d-8b75-41decb50a794 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:34.009210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 239/477] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:34.009828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43fd5-2c5a-4bd5-b0c3-3d60821a9c38 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:34.135365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 239/478] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 21 21:08:34.136250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626c4a8-2b09-421d-8b75-41decb50a794 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:34.149862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43fd5-2c5a-4bd5-b0c3-3d60821a9c38 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:34.185158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f160c9-51f7-46cb-b5ee-6167a871d8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:34.185761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f160c9-51f7-46cb-b5ee-6167a871d8fe None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:34.186042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f160c9-51f7-46cb-b5ee-6167a871d8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:34.186315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f160c9-51f7-46cb-b5ee-6167a871d8fe None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:34.187005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f160c9-51f7-46cb-b5ee-6167a871d8fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:34.187328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f160c9-51f7-46cb-b5ee-6167a871d8fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:34.188739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f160c9-51f7-46cb-b5ee-6167a871d8fe None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:34.202354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 240/479] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:34.204095 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f160c9-51f7-46cb-b5ee-6167a871d8fe None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:34.227036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:34.247597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626c4a8-2b09-421d-8b75-41decb50a794 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:34.260251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:34.284005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28190bd1-848b-4283-8469-56f38923cc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:34.284607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190bd1-848b-4283-8469-56f38923cc23 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:34.284887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190bd1-848b-4283-8469-56f38923cc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:34.285161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190bd1-848b-4283-8469-56f38923cc23 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:34.285849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28190bd1-848b-4283-8469-56f38923cc23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:34.286154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28190bd1-848b-4283-8469-56f38923cc23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:34.287603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28190bd1-848b-4283-8469-56f38923cc23 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:34.303746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 240/480] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:34.303746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409953-c538-44d6-b328-4173364a210d None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:34.303746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409953-c538-44d6-b328-4173364a210d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:34.303746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409953-c538-44d6-b328-4173364a210d None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:34.303746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 241/481] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:34.303746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409953-c538-44d6-b328-4173364a210d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:34.319251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f160c9-51f7-46cb-b5ee-6167a871d8fe None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:34.356536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c7426-bc24-4037-b3c9-4597f8569723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:34.357363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c7426-bc24-4037-b3c9-4597f8569723 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:34.357784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c7426-bc24-4037-b3c9-4597f8569723 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:34.358208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c7426-bc24-4037-b3c9-4597f8569723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:34.368893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c7426-bc24-4037-b3c9-4597f8569723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:34.370334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c7426-bc24-4037-b3c9-4597f8569723 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-d55c7426-bc24-4037-b3c9-4597f8569723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:34.386040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:34.387135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:34.388193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:34.388193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:34.388193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:34.388193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 241/482] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:34.388193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c7426-bc24-4037-b3c9-4597f8569723 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:34.415668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409953-c538-44d6-b328-4173364a210d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:34.449280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87122113-c7b5-403d-bfa7-db9eb8e88196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:34.449887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122113-c7b5-403d-bfa7-db9eb8e88196 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:34.450168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122113-c7b5-403d-bfa7-db9eb8e88196 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:34.450439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122113-c7b5-403d-bfa7-db9eb8e88196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:34.451153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87122113-c7b5-403d-bfa7-db9eb8e88196 None admin] RBAC: Adding query filter params (role.id=9551be8340204b80958e4788f306cff6, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=31f812676e6f4b258f556d5a0b54dc46) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:34.451490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87122113-c7b5-403d-bfa7-db9eb8e88196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:34.452921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87122113-c7b5-403d-bfa7-db9eb8e88196 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:34.458593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 242/483] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:08:34 2022] GET /identity/v3/role_assignments?user.id=31f812676e6f4b258f556d5a0b54dc46&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=9551be8340204b80958e4788f306cff6 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:34.459781 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcb065-66a8-4459-b60c-e993c867c5fc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:34.460065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcb065-66a8-4459-b60c-e993c867c5fc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:34.460339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcb065-66a8-4459-b60c-e993c867c5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:34.468740 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:34.482651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-86bcb065-66a8-4459-b60c-e993c867c5fc None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:34.483825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-86bcb065-66a8-4459-b60c-e993c867c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:34.511029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:34.516176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c7426-bc24-4037-b3c9-4597f8569723 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:34.559012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df735d-adf5-41a2-9d40-dcc676a90bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:34.559693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df735d-adf5-41a2-9d40-dcc676a90bdf None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:34.559975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df735d-adf5-41a2-9d40-dcc676a90bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:34.560242 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df735d-adf5-41a2-9d40-dcc676a90bdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:34.560991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df735d-adf5-41a2-9d40-dcc676a90bdf None admin] RBAC: Adding query filter params (role.id=9551be8340204b80958e4788f306cff6, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=59ec1b2a49264e4e9218b65f9ff114b9) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:34.561431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df735d-adf5-41a2-9d40-dcc676a90bdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:34.562910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df735d-adf5-41a2-9d40-dcc676a90bdf None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:34.575806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 242/485] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:08:34 2022] GET /identity/v3/role_assignments?user.id=59ec1b2a49264e4e9218b65f9ff114b9&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=9551be8340204b80958e4788f306cff6 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:34.576050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 243/485] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:34.576832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df735d-adf5-41a2-9d40-dcc676a90bdf None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:34.733160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df735d-adf5-41a2-9d40-dcc676a90bdf None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:34.772497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863863c-0ed1-46a1-af85-3cf7b8657e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:34.773130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863863c-0ed1-46a1-af85-3cf7b8657e44 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:34.773445 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863863c-0ed1-46a1-af85-3cf7b8657e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:34.773754 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863863c-0ed1-46a1-af85-3cf7b8657e44 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:34.774448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863863c-0ed1-46a1-af85-3cf7b8657e44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:34.774787 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863863c-0ed1-46a1-af85-3cf7b8657e44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:34.776266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863863c-0ed1-46a1-af85-3cf7b8657e44 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:34.792464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 243/486] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:34.798131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcb065-66a8-4459-b60c-e993c867c5fc None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:34.900713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863863c-0ed1-46a1-af85-3cf7b8657e44 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:34.931086 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:34.934926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcb065-66a8-4459-b60c-e993c867c5fc None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:34.976318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2718fb-6995-4a71-aafe-63cd06026053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:34.976952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2718fb-6995-4a71-aafe-63cd06026053 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:34.977229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2718fb-6995-4a71-aafe-63cd06026053 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:34.977499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2718fb-6995-4a71-aafe-63cd06026053 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:34.979616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:34.985603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2718fb-6995-4a71-aafe-63cd06026053 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:34.988051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2718fb-6995-4a71-aafe-63cd06026053 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-2c2718fb-6995-4a71-aafe-63cd06026053 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:35.000668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:35.001557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:35.003590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:35.003590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:35.003590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:35.003590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:35.003590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:35.003590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:35.003590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:35.003590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:35.003590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 244/487] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:35.007841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2718fb-6995-4a71-aafe-63cd06026053 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:35.029616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863863c-0ed1-46a1-af85-3cf7b8657e44 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:35.085841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471bc95-9d13-4270-883b-4e896431dd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:35.087339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471bc95-9d13-4270-883b-4e896431dd7d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:35.087861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471bc95-9d13-4270-883b-4e896431dd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:35.088602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471bc95-9d13-4270-883b-4e896431dd7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:35.103476 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471bc95-9d13-4270-883b-4e896431dd7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-a471bc95-9d13-4270-883b-4e896431dd7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:35.108512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:35.109398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:35.110174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 244/488] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:08:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:35.111414 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c5b3-229d-4202-b656-7e7dae18b47e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:35.111414 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c5b3-229d-4202-b656-7e7dae18b47e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:35.111674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c5b3-229d-4202-b656-7e7dae18b47e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:35.113945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 245/489] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:35.119319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c5b3-229d-4202-b656-7e7dae18b47e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:35.138662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2718fb-6995-4a71-aafe-63cd06026053 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:35.180247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de73d7-87bc-4272-ae19-17fe74282f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:35.181048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de73d7-87bc-4272-ae19-17fe74282f16 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:35.181546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de73d7-87bc-4272-ae19-17fe74282f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:35.181977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de73d7-87bc-4272-ae19-17fe74282f16 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:35.182729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de73d7-87bc-4272-ae19-17fe74282f16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:35.183096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de73d7-87bc-4272-ae19-17fe74282f16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:35.184825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de73d7-87bc-4272-ae19-17fe74282f16 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:35.197962 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 245/490] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:35.199658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a679c8f-e6de-4834-a3a1-8944f6f5057d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:35.200010 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a679c8f-e6de-4834-a3a1-8944f6f5057d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:35.200350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a679c8f-e6de-4834-a3a1-8944f6f5057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:35.210638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:35.222624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7a679c8f-e6de-4834-a3a1-8944f6f5057d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:35.224001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7a679c8f-e6de-4834-a3a1-8944f6f5057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:35.231979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c5b3-229d-4202-b656-7e7dae18b47e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:35.267534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f3652-3cd4-4a4a-9cac-703d8ac710d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:35.268599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f3652-3cd4-4a4a-9cac-703d8ac710d7 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:35.268878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f3652-3cd4-4a4a-9cac-703d8ac710d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:35.269152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f3652-3cd4-4a4a-9cac-703d8ac710d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:35.269818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f3652-3cd4-4a4a-9cac-703d8ac710d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:35.270121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f3652-3cd4-4a4a-9cac-703d8ac710d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:35.271540 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f3652-3cd4-4a4a-9cac-703d8ac710d7 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:35.280194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 246/491] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:35.280995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f3652-3cd4-4a4a-9cac-703d8ac710d7 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:35.285196 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:35.307405 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 246/492] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:35.308743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a679c8f-e6de-4834-a3a1-8944f6f5057d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:35.387848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f3652-3cd4-4a4a-9cac-703d8ac710d7 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:35.424269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a679c8f-e6de-4834-a3a1-8944f6f5057d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:35.424496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16e950-eb52-4670-808d-c08eeb8df6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:35.424991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16e950-eb52-4670-808d-c08eeb8df6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:35.425270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16e950-eb52-4670-808d-c08eeb8df6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:35.425544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16e950-eb52-4670-808d-c08eeb8df6d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:35.426280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16e950-eb52-4670-808d-c08eeb8df6d2 None admin] RBAC: Adding query filter params (role.id=9551be8340204b80958e4788f306cff6, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=ad7ef5b260e4425c93ebbe85570136db) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:35.426590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16e950-eb52-4670-808d-c08eeb8df6d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:35.428037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16e950-eb52-4670-808d-c08eeb8df6d2 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:35.434449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 247/493] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:08:35 2022] GET /identity/v3/role_assignments?user.id=ad7ef5b260e4425c93ebbe85570136db&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=9551be8340204b80958e4788f306cff6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:35.467061 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3897535-783b-4b76-a360-cfbb498e275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:35.468045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3897535-783b-4b76-a360-cfbb498e275a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:35.468460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3897535-783b-4b76-a360-cfbb498e275a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:35.468896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3897535-783b-4b76-a360-cfbb498e275a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:35.481742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3897535-783b-4b76-a360-cfbb498e275a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:35.483455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3897535-783b-4b76-a360-cfbb498e275a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-c3897535-783b-4b76-a360-cfbb498e275a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:35.500899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:35.502029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:35.503730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:35.503730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:35.503730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:35.510028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 247/494] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:35.511814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16e950-eb52-4670-808d-c08eeb8df6d2 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:35.527204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:35.646921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16e950-eb52-4670-808d-c08eeb8df6d2 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:35.685561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1838b4-32df-487d-a67c-f5bc7ad50df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:35.686401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1838b4-32df-487d-a67c-f5bc7ad50df5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:35.686815 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1838b4-32df-487d-a67c-f5bc7ad50df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:35.687221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1838b4-32df-487d-a67c-f5bc7ad50df5 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:35.688044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1838b4-32df-487d-a67c-f5bc7ad50df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:35.688612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1838b4-32df-487d-a67c-f5bc7ad50df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:35.690694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1838b4-32df-487d-a67c-f5bc7ad50df5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:35.696675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3897535-783b-4b76-a360-cfbb498e275a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:35.704984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 248/495] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:35.711570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1838b4-32df-487d-a67c-f5bc7ad50df5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:35.745873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:35.829130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3897535-783b-4b76-a360-cfbb498e275a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:35.831951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:35.883959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916b8aa-e4d9-4c34-9fee-c83e93cbc6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:35.884604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916b8aa-e4d9-4c34-9fee-c83e93cbc6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:35.884883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916b8aa-e4d9-4c34-9fee-c83e93cbc6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:35.885158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916b8aa-e4d9-4c34-9fee-c83e93cbc6f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:35.889590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1838b4-32df-487d-a67c-f5bc7ad50df5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:35.910638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916b8aa-e4d9-4c34-9fee-c83e93cbc6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-d916b8aa-e4d9-4c34-9fee-c83e93cbc6f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:35.917449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:35.918368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:35.919283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 248/496] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:35.930684 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916b8aa-e4d9-4c34-9fee-c83e93cbc6f9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:35.966628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa235a-d6fb-4837-9495-ed502138eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:35.967566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa235a-d6fb-4837-9495-ed502138eac8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:35.967988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa235a-d6fb-4837-9495-ed502138eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:35.968400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa235a-d6fb-4837-9495-ed502138eac8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:35.979319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa235a-d6fb-4837-9495-ed502138eac8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:35.980967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa235a-d6fb-4837-9495-ed502138eac8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-83fa235a-d6fb-4837-9495-ed502138eac8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:36.009240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:36.010462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:36.011638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:36.011638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:36.011638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:36.011638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:36.011638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:36.011638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:36.011638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:36.011638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:36.011638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:08:36.011638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:36.013787 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 249/497] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 21 21:08:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:36.027841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa235a-d6fb-4837-9495-ed502138eac8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:36.068327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916b8aa-e4d9-4c34-9fee-c83e93cbc6f9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:36.071627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:36.128111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e346c-e2e5-4f0c-8530-46ba281c4530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:36.129008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e346c-e2e5-4f0c-8530-46ba281c4530 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:36.129434 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e346c-e2e5-4f0c-8530-46ba281c4530 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:36.129850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e346c-e2e5-4f0c-8530-46ba281c4530 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:36.130675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e346c-e2e5-4f0c-8530-46ba281c4530 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:36.131121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e346c-e2e5-4f0c-8530-46ba281c4530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:36.132655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e346c-e2e5-4f0c-8530-46ba281c4530 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:36.153652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 249/498] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:36.159999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e346c-e2e5-4f0c-8530-46ba281c4530 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:36.163156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa235a-d6fb-4837-9495-ed502138eac8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:36.208585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:36.219331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c6dc0-8456-465e-8f27-86d21ed0c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:36.220653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6dc0-8456-465e-8f27-86d21ed0c6cc None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:36.221351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6dc0-8456-465e-8f27-86d21ed0c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:36.223574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6dc0-8456-465e-8f27-86d21ed0c6cc None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:36.224480 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c6dc0-8456-465e-8f27-86d21ed0c6cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:36.225109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c6dc0-8456-465e-8f27-86d21ed0c6cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:36.227296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c6dc0-8456-465e-8f27-86d21ed0c6cc None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:36.259861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 250/499] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 21 21:08:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:36.267199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c6dc0-8456-465e-8f27-86d21ed0c6cc None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:36.345636 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e346c-e2e5-4f0c-8530-46ba281c4530 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:36.409891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730b1b5-de65-47e2-b4d0-a48f433de8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:36.410444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b1b5-de65-47e2-b4d0-a48f433de8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:36.410721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b1b5-de65-47e2-b4d0-a48f433de8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:36.410993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b1b5-de65-47e2-b4d0-a48f433de8c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:36.424741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c6dc0-8456-465e-8f27-86d21ed0c6cc None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:36.435039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730b1b5-de65-47e2-b4d0-a48f433de8c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:36.436530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730b1b5-de65-47e2-b4d0-a48f433de8c6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-7730b1b5-de65-47e2-b4d0-a48f433de8c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:36.457285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:36.458265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:36.459705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:36.459705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:36.459705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:36.462106 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 250/500] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:36.468228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730b1b5-de65-47e2-b4d0-a48f433de8c6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:36.483662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:36.505794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2384a24-18ef-47f0-8e18-6d5e6a15caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:36.506437 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384a24-18ef-47f0-8e18-6d5e6a15caaf None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:36.506713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384a24-18ef-47f0-8e18-6d5e6a15caaf None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:36.507881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384a24-18ef-47f0-8e18-6d5e6a15caaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:36.529041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2384a24-18ef-47f0-8e18-6d5e6a15caaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:36.531971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2384a24-18ef-47f0-8e18-6d5e6a15caaf None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-d2384a24-18ef-47f0-8e18-6d5e6a15caaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:36.562110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:36.563134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:36.564118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:36.564118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:36.564118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:36.568095 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 251/501] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:36.570199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2384a24-18ef-47f0-8e18-6d5e6a15caaf None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:36.627677 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:36.675260 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730b1b5-de65-47e2-b4d0-a48f433de8c6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:36.741244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2384a24-18ef-47f0-8e18-6d5e6a15caaf None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:36.746689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd088c2e-4a95-43bd-9a28-24f9e7799210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:36.749574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd088c2e-4a95-43bd-9a28-24f9e7799210 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:36.749854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd088c2e-4a95-43bd-9a28-24f9e7799210 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:36.750123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd088c2e-4a95-43bd-9a28-24f9e7799210 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:36.750761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd088c2e-4a95-43bd-9a28-24f9e7799210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:36.751058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd088c2e-4a95-43bd-9a28-24f9e7799210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:36.752470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd088c2e-4a95-43bd-9a28-24f9e7799210 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:36.780874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 251/502] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:36.786841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd088c2e-4a95-43bd-9a28-24f9e7799210 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:36.811850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e9076-408a-4914-a03b-10d388664dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:36.812462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e9076-408a-4914-a03b-10d388664dff None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:36.812739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e9076-408a-4914-a03b-10d388664dff None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:36.813012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e9076-408a-4914-a03b-10d388664dff None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:36.813905 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e9076-408a-4914-a03b-10d388664dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:36.815140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e9076-408a-4914-a03b-10d388664dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:36.817633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e9076-408a-4914-a03b-10d388664dff None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:36.850946 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 252/503] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:36.852546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e9076-408a-4914-a03b-10d388664dff None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:36.943629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:36.974966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:36.981070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e9076-408a-4914-a03b-10d388664dff None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:37.014498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd088c2e-4a95-43bd-9a28-24f9e7799210 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:37.045270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6df2e-21a4-4373-930b-6f2b5105b99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:37.046003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6df2e-21a4-4373-930b-6f2b5105b99c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.046283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6df2e-21a4-4373-930b-6f2b5105b99c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.046548 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6df2e-21a4-4373-930b-6f2b5105b99c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.059357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6df2e-21a4-4373-930b-6f2b5105b99c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:37.059357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6df2e-21a4-4373-930b-6f2b5105b99c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:37.068940 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8a7a1-1099-4b61-806f-b0345257e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:37.069573 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a7a1-1099-4b61-806f-b0345257e28d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.069850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a7a1-1099-4b61-806f-b0345257e28d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-63a6df2e-21a4-4373-930b-6f2b5105b99c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:37.069973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:37.070851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:37.071781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:37.071781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:37.071781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:37.071781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:37.071781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:37.071781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:37.071781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:37.071781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:37.072206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8a7a1-1099-4b61-806f-b0345257e28d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.076211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 253/504] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:37.077571 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147fd41-b3ba-47dc-98bf-796a310a9ee6 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.077687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8a7a1-1099-4b61-806f-b0345257e28d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:37.077851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147fd41-b3ba-47dc-98bf-796a310a9ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.078118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147fd41-b3ba-47dc-98bf-796a310a9ee6 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.079089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8a7a1-1099-4b61-806f-b0345257e28d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:37.080153 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 254/505] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:37.081545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147fd41-b3ba-47dc-98bf-796a310a9ee6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-9ad8a7a1-1099-4b61-806f-b0345257e28d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:37.097189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:37.099432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:37.101670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 252/506] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:08:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:37.107307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9fa62-0905-4640-abf1-d108018fccb4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.107307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9fa62-0905-4640-abf1-d108018fccb4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.107307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9fa62-0905-4640-abf1-d108018fccb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.124111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4fb9fa62-0905-4640-abf1-d108018fccb4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:37.125396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4fb9fa62-0905-4640-abf1-d108018fccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:37.201415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147fd41-b3ba-47dc-98bf-796a310a9ee6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:37.205412 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 253/507] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:37.206654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9fa62-0905-4640-abf1-d108018fccb4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:37.271300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:37.296560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96001fe-83fb-42fe-bad5-7968ad9db16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:37.297473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96001fe-83fb-42fe-bad5-7968ad9db16e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.298039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96001fe-83fb-42fe-bad5-7968ad9db16e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.298606 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96001fe-83fb-42fe-bad5-7968ad9db16e None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.300515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96001fe-83fb-42fe-bad5-7968ad9db16e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:37.301162 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96001fe-83fb-42fe-bad5-7968ad9db16e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:37.303960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96001fe-83fb-42fe-bad5-7968ad9db16e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:37.316971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9fa62-0905-4640-abf1-d108018fccb4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:37.355294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 255/508] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:37.359311 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fc60a-6c4c-481c-9cbf-3e3db10ac577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:37.360150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fc60a-6c4c-481c-9cbf-3e3db10ac577 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.360577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fc60a-6c4c-481c-9cbf-3e3db10ac577 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.360986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fc60a-6c4c-481c-9cbf-3e3db10ac577 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.362582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fc60a-6c4c-481c-9cbf-3e3db10ac577 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:37.363031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fc60a-6c4c-481c-9cbf-3e3db10ac577 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:37.364649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fc60a-6c4c-481c-9cbf-3e3db10ac577 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:37.368991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96001fe-83fb-42fe-bad5-7968ad9db16e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:37.388382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 254/509] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 21 21:08:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:37.403934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fc60a-6c4c-481c-9cbf-3e3db10ac577 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:37.433220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:37.548993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fc60a-6c4c-481c-9cbf-3e3db10ac577 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:37.560639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96001fe-83fb-42fe-bad5-7968ad9db16e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:37.568349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:37.593423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17e07-adf7-4ebc-b53e-b83f9eef2261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:37.594439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17e07-adf7-4ebc-b53e-b83f9eef2261 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.594871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17e07-adf7-4ebc-b53e-b83f9eef2261 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.595287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17e07-adf7-4ebc-b53e-b83f9eef2261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.599287 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42122b25-3bb0-4605-ab23-6801bdf5aa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:37.600003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122b25-3bb0-4605-ab23-6801bdf5aa6b None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.600346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122b25-3bb0-4605-ab23-6801bdf5aa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.600684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122b25-3bb0-4605-ab23-6801bdf5aa6b None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/8afe54a4c63b4a50a6240293e2be6450/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.602691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42122b25-3bb0-4605-ab23-6801bdf5aa6b None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=8afe54a4c63b4a50a6240293e2be6450, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:37.604223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42122b25-3bb0-4605-ab23-6801bdf5aa6b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:37.619758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 256/510] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:08:37 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/8afe54a4c63b4a50a6240293e2be6450/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:37.621489 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9446d43-600e-4314-97f3-a02e7e2ae0bd None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.621995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9446d43-600e-4314-97f3-a02e7e2ae0bd None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.622369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9446d43-600e-4314-97f3-a02e7e2ae0bd None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.624275 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 257/511] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:37.630903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab72e9-3c40-44a7-bbaa-eb09ecd475a8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.631206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab72e9-3c40-44a7-bbaa-eb09ecd475a8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.631468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab72e9-3c40-44a7-bbaa-eb09ecd475a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.662913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-32ab72e9-3c40-44a7-bbaa-eb09ecd475a8 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:37.664203 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-32ab72e9-3c40-44a7-bbaa-eb09ecd475a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:37.683854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d17e07-adf7-4ebc-b53e-b83f9eef2261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:37.685790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d17e07-adf7-4ebc-b53e-b83f9eef2261 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:37.763719 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 258/512] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:37.764396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab72e9-3c40-44a7-bbaa-eb09ecd475a8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:37.794870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:37.840021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 255/513] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 21 21:08:37.850393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17e07-adf7-4ebc-b53e-b83f9eef2261 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:37.872350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:37.918566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab72e9-3c40-44a7-bbaa-eb09ecd475a8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:37.959767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2a104-dd4f-4b6c-b846-a853a5face5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:37.960451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2a104-dd4f-4b6c-b846-a853a5face5d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:37.960884 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2a104-dd4f-4b6c-b846-a853a5face5d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:37.961156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2a104-dd4f-4b6c-b846-a853a5face5d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:37.961922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2a104-dd4f-4b6c-b846-a853a5face5d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:37.963825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2a104-dd4f-4b6c-b846-a853a5face5d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:37.972687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17e07-adf7-4ebc-b53e-b83f9eef2261 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-6ab2a104-dd4f-4b6c-b846-a853a5face5d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:37.976286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:37.977261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:37.978087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 259/514] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Oct 21 21:08:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:37.986095 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2a104-dd4f-4b6c-b846-a853a5face5d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:38.014625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc827a0c-f5c9-4122-a09b-6cde763dc58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:38.015280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc827a0c-f5c9-4122-a09b-6cde763dc58d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.015673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc827a0c-f5c9-4122-a09b-6cde763dc58d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.015956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc827a0c-f5c9-4122-a09b-6cde763dc58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.027237 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc827a0c-f5c9-4122-a09b-6cde763dc58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:38.028834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc827a0c-f5c9-4122-a09b-6cde763dc58d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-cc827a0c-f5c9-4122-a09b-6cde763dc58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:38.045330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:38.048014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:38.051239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:38.051239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:38.051239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:38.051239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 256/515] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:38.063170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc827a0c-f5c9-4122-a09b-6cde763dc58d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:38.074067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:38.104751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2a104-dd4f-4b6c-b846-a853a5face5d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:38.145468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406e1c5-06fc-4229-bce7-18a53677f406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:38.146375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406e1c5-06fc-4229-bce7-18a53677f406 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.146836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406e1c5-06fc-4229-bce7-18a53677f406 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.147517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406e1c5-06fc-4229-bce7-18a53677f406 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.148946 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406e1c5-06fc-4229-bce7-18a53677f406 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:38.149432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406e1c5-06fc-4229-bce7-18a53677f406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:38.151198 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:38.152745 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406e1c5-06fc-4229-bce7-18a53677f406 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:38.163428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 260/516] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 21 21:08:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:38.163428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406e1c5-06fc-4229-bce7-18a53677f406 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:38.185445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc827a0c-f5c9-4122-a09b-6cde763dc58d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:38.228317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6820c8-6cab-4146-a472-04b33ec40bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:38.229271 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6820c8-6cab-4146-a472-04b33ec40bcb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.229814 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6820c8-6cab-4146-a472-04b33ec40bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.230444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6820c8-6cab-4146-a472-04b33ec40bcb None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.231762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6820c8-6cab-4146-a472-04b33ec40bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:38.232256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6820c8-6cab-4146-a472-04b33ec40bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:38.234303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6820c8-6cab-4146-a472-04b33ec40bcb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:38.251917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 257/517] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:38.251917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7c248-ca89-46df-8de3-1a6f38397470 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.251917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7c248-ca89-46df-8de3-1a6f38397470 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.251917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7c248-ca89-46df-8de3-1a6f38397470 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.251917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 258/518] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:38.251917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7c248-ca89-46df-8de3-1a6f38397470 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:38.276769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406e1c5-06fc-4229-bce7-18a53677f406 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:38.311822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e425095-f1b2-4f40-ac27-01377e3752df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:38.312451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e425095-f1b2-4f40-ac27-01377e3752df None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.312726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e425095-f1b2-4f40-ac27-01377e3752df None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.313002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e425095-f1b2-4f40-ac27-01377e3752df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.320623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:38.324757 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e425095-f1b2-4f40-ac27-01377e3752df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:38.326756 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e425095-f1b2-4f40-ac27-01377e3752df None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9e425095-f1b2-4f40-ac27-01377e3752df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:38.341870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:38.342843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:38.343797 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:38.343797 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:38.343797 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:38.348512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 261/519] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:38.349348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e425095-f1b2-4f40-ac27-01377e3752df None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:38.364354 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7c248-ca89-46df-8de3-1a6f38397470 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:38.393874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:38.400365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ddcc8-7d34-4758-a6d9-150ed444d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:38.400985 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ddcc8-7d34-4758-a6d9-150ed444d4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.401267 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ddcc8-7d34-4758-a6d9-150ed444d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.401545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ddcc8-7d34-4758-a6d9-150ed444d4d9 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.402182 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ddcc8-7d34-4758-a6d9-150ed444d4d9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:38.402603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ddcc8-7d34-4758-a6d9-150ed444d4d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:38.404162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ddcc8-7d34-4758-a6d9-150ed444d4d9 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:38.410976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 259/520] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 21 21:08:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:38.412217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b06ba3-7ac0-4e85-8b16-a6bd918c44b8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.412505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b06ba3-7ac0-4e85-8b16-a6bd918c44b8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.412784 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b06ba3-7ac0-4e85-8b16-a6bd918c44b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.432808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c5b06ba3-7ac0-4e85-8b16-a6bd918c44b8 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:38.434042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c5b06ba3-7ac0-4e85-8b16-a6bd918c44b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:38.481405 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e425095-f1b2-4f40-ac27-01377e3752df None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:38.519615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 260/521] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:38.521015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b06ba3-7ac0-4e85-8b16-a6bd918c44b8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:38.531794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8adb1-2002-45b1-ae6d-0c489fe4232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:38.532455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8adb1-2002-45b1-ae6d-0c489fe4232f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.532748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8adb1-2002-45b1-ae6d-0c489fe4232f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.533011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8adb1-2002-45b1-ae6d-0c489fe4232f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.545774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8adb1-2002-45b1-ae6d-0c489fe4232f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:38.547252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8adb1-2002-45b1-ae6d-0c489fe4232f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-b9b8adb1-2002-45b1-ae6d-0c489fe4232f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:38.574760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:38.575751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:38.576659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:38.576659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:38.576659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:38.576659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:38.576659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:38.576659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:38.576659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:38.576659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:38.576659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 262/522] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:38.582463 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8adb1-2002-45b1-ae6d-0c489fe4232f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:38.664932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:38.731824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b06ba3-7ac0-4e85-8b16-a6bd918c44b8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:38.741305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8adb1-2002-45b1-ae6d-0c489fe4232f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:38.779118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c77cae-4a90-4f87-9266-ed75df445d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:38.780256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77cae-4a90-4f87-9266-ed75df445d57 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.780708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77cae-4a90-4f87-9266-ed75df445d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.781153 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77cae-4a90-4f87-9266-ed75df445d57 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.782015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c77cae-4a90-4f87-9266-ed75df445d57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:38.782536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c77cae-4a90-4f87-9266-ed75df445d57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:38.784201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c77cae-4a90-4f87-9266-ed75df445d57 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:38.802510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 263/523] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:38.803097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:38.805390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c77cae-4a90-4f87-9266-ed75df445d57 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:38.839987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665ac00-918f-454d-b848-ff5efb1e239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:38.840614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ac00-918f-454d-b848-ff5efb1e239c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.840887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ac00-918f-454d-b848-ff5efb1e239c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.841163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665ac00-918f-454d-b848-ff5efb1e239c None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.841813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665ac00-918f-454d-b848-ff5efb1e239c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:38.842120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665ac00-918f-454d-b848-ff5efb1e239c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:38.847314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665ac00-918f-454d-b848-ff5efb1e239c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:38.858752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 261/524] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:38.859811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665ac00-918f-454d-b848-ff5efb1e239c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:38.929541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c77cae-4a90-4f87-9266-ed75df445d57 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:38.942022 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:38.973980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2ba3-9548-413f-8700-75c9fe1c6154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:38.974765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2ba3-9548-413f-8700-75c9fe1c6154 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:38.975204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2ba3-9548-413f-8700-75c9fe1c6154 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:38.975600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a2ba3-9548-413f-8700-75c9fe1c6154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:38.976442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2ba3-9548-413f-8700-75c9fe1c6154 None admin] RBAC: Adding query filter params (role.id=9551be8340204b80958e4788f306cff6, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=e2dc36f09ae941ecbf30ff11475e7f74) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:38.976849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2ba3-9548-413f-8700-75c9fe1c6154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:38.978409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a2ba3-9548-413f-8700-75c9fe1c6154 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:38.991297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 264/525] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:08:38 2022] GET /identity/v3/role_assignments?user.id=e2dc36f09ae941ecbf30ff11475e7f74&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=9551be8340204b80958e4788f306cff6 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:38.991297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2ba3-9548-413f-8700-75c9fe1c6154 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:39.009742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665ac00-918f-454d-b848-ff5efb1e239c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:39.124058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe814d6-5bca-49c9-98c2-dd37b7c5f7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:39.124732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe814d6-5bca-49c9-98c2-dd37b7c5f7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:39.125022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe814d6-5bca-49c9-98c2-dd37b7c5f7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:39.125322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe814d6-5bca-49c9-98c2-dd37b7c5f7b3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:39.125900 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe814d6-5bca-49c9-98c2-dd37b7c5f7b3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:39.128336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe814d6-5bca-49c9-98c2-dd37b7c5f7b3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:39.132289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a2ba3-9548-413f-8700-75c9fe1c6154 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-bbe814d6-5bca-49c9-98c2-dd37b7c5f7b3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:39.152035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:39.153428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:39.154955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 262/526] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:38 2022] GET /identity/v3/services/network => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:39.160716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe814d6-5bca-49c9-98c2-dd37b7c5f7b3 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:39.223779 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405abda3-9111-4007-8186-a191221b7961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:39.225975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405abda3-9111-4007-8186-a191221b7961 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:39.226252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405abda3-9111-4007-8186-a191221b7961 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:39.226521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405abda3-9111-4007-8186-a191221b7961 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:39.227171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405abda3-9111-4007-8186-a191221b7961 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:39.228634 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405abda3-9111-4007-8186-a191221b7961 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:39.248560 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:39.257581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 265/527] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:08:38 2022] POST /identity/v3/users => generated 254 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:39.326915 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe814d6-5bca-49c9-98c2-dd37b7c5f7b3 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:39.371623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31711f9-f9dd-4a41-a83d-5992061b1f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:39.372654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31711f9-f9dd-4a41-a83d-5992061b1f8a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:39.373145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31711f9-f9dd-4a41-a83d-5992061b1f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:39.373688 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31711f9-f9dd-4a41-a83d-5992061b1f8a None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:39.374540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31711f9-f9dd-4a41-a83d-5992061b1f8a None admin] RBAC: Adding query filter params (name=network) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:39.375087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31711f9-f9dd-4a41-a83d-5992061b1f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:39.376881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31711f9-f9dd-4a41-a83d-5992061b1f8a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:39.382882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 263/528] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:08:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:39.391314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405abda3-9111-4007-8186-a191221b7961 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:39.431081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:39.527017 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405abda3-9111-4007-8186-a191221b7961 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:39.568589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b165e8-2f38-4e21-90fa-503e1c942e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:39.569340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b165e8-2f38-4e21-90fa-503e1c942e9b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:39.569615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b165e8-2f38-4e21-90fa-503e1c942e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:39.569889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b165e8-2f38-4e21-90fa-503e1c942e9b None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:39.570533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b165e8-2f38-4e21-90fa-503e1c942e9b None admin] RBAC: Adding query filter params (type=network) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:39.570834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b165e8-2f38-4e21-90fa-503e1c942e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:39.572314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b165e8-2f38-4e21-90fa-503e1c942e9b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:39.579141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 266/529] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:08:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:40.305343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce846933-27ae-4dee-936a-a9691c21af2c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:40.305343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce846933-27ae-4dee-936a-a9691c21af2c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:40.305343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce846933-27ae-4dee-936a-a9691c21af2c None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:40.306509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 264/530] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:40.313777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7750d54-6b4a-49c2-bfa5-f4a3e20e4f70 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:40.313777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7750d54-6b4a-49c2-bfa5-f4a3e20e4f70 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:40.313777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7750d54-6b4a-49c2-bfa5-f4a3e20e4f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:40.339563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e7750d54-6b4a-49c2-bfa5-f4a3e20e4f70 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:40.341141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e7750d54-6b4a-49c2-bfa5-f4a3e20e4f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:40.424517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 267/531] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:40.723811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce846933-27ae-4dee-936a-a9691c21af2c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:40.853690 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce846933-27ae-4dee-936a-a9691c21af2c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:40.878205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:40.906879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f7784-5680-4fe9-8d3d-4e096a0c6b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:40.907555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f7784-5680-4fe9-8d3d-4e096a0c6b66 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:40.907840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f7784-5680-4fe9-8d3d-4e096a0c6b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:40.908116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f7784-5680-4fe9-8d3d-4e096a0c6b66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:40.924520 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f7784-5680-4fe9-8d3d-4e096a0c6b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-035f7784-5680-4fe9-8d3d-4e096a0c6b66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:40.929766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:40.930691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:40.932174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 265/532] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:08:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:40.936632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7750d54-6b4a-49c2-bfa5-f4a3e20e4f70 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:40.979247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:41.087321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7750d54-6b4a-49c2-bfa5-f4a3e20e4f70 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:41.090058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcd0a8-7003-4ff0-beeb-017660b1bd09 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:41.090655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcd0a8-7003-4ff0-beeb-017660b1bd09 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:41.091163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcd0a8-7003-4ff0-beeb-017660b1bd09 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:41.093607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 266/533] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:41.099554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e21e-a3e1-4d20-ac2a-c2dbedc267c4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:41.100550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e21e-a3e1-4d20-ac2a-c2dbedc267c4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:41.101054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e21e-a3e1-4d20-ac2a-c2dbedc267c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:41.132624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e4a6e21e-a3e1-4d20-ac2a-c2dbedc267c4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:41.133830 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e4a6e21e-a3e1-4d20-ac2a-c2dbedc267c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:41.140136 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d646b44-97b8-4c31-ac40-0ef6d64fb2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:41.140751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d646b44-97b8-4c31-ac40-0ef6d64fb2ce None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:41.141031 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d646b44-97b8-4c31-ac40-0ef6d64fb2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:41.141305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d646b44-97b8-4c31-ac40-0ef6d64fb2ce None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:41.141969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d646b44-97b8-4c31-ac40-0ef6d64fb2ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:41.142274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d646b44-97b8-4c31-ac40-0ef6d64fb2ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:41.144219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d646b44-97b8-4c31-ac40-0ef6d64fb2ce None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:41.160387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 268/534] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:41.175825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d646b44-97b8-4c31-ac40-0ef6d64fb2ce None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:41.256989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 267/535] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:08:41.291606 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:41.307047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d646b44-97b8-4c31-ac40-0ef6d64fb2ce None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:41.349754 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e620c-fb77-423e-819d-7421a00583dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:41.350371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e620c-fb77-423e-819d-7421a00583dc None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:41.350642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e620c-fb77-423e-819d-7421a00583dc None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:41.350916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e620c-fb77-423e-819d-7421a00583dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:41.365903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e620c-fb77-423e-819d-7421a00583dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:41.367367 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e620c-fb77-423e-819d-7421a00583dc None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-cc3e620c-fb77-423e-819d-7421a00583dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:41.385143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:41.386113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:41.387006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:41.387006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:41.387006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:41.391587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 269/536] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:41.391952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6e21e-a3e1-4d20-ac2a-c2dbedc267c4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:41.595055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6e21e-a3e1-4d20-ac2a-c2dbedc267c4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:41.599579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:41.631173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e620c-fb77-423e-819d-7421a00583dc None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:41.656416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192477d9-da5b-48ae-a899-2109c6918fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:41.657042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192477d9-da5b-48ae-a899-2109c6918fec None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:41.657578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192477d9-da5b-48ae-a899-2109c6918fec None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:41.657864 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192477d9-da5b-48ae-a899-2109c6918fec None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:41.658515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192477d9-da5b-48ae-a899-2109c6918fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:41.658850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192477d9-da5b-48ae-a899-2109c6918fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:41.660732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192477d9-da5b-48ae-a899-2109c6918fec None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:41.685107 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 268/537] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:41.686266 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192477d9-da5b-48ae-a899-2109c6918fec None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:41.797053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e620c-fb77-423e-819d-7421a00583dc None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:41.852964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192477d9-da5b-48ae-a899-2109c6918fec None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:41.872419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca6677-d559-4cbf-bdb9-d5df74d81d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:41.873261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca6677-d559-4cbf-bdb9-d5df74d81d05 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:41.873374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca6677-d559-4cbf-bdb9-d5df74d81d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:41.873571 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca6677-d559-4cbf-bdb9-d5df74d81d05 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:41.874233 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca6677-d559-4cbf-bdb9-d5df74d81d05 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:41.875623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca6677-d559-4cbf-bdb9-d5df74d81d05 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:41.897337 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:41.908606 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 270/538] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:08:41 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:08:41.923133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc079dd1-0a28-47cf-a08e-bf52cda019bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:41.923810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc079dd1-0a28-47cf-a08e-bf52cda019bb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:41.924093 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc079dd1-0a28-47cf-a08e-bf52cda019bb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:41.924401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc079dd1-0a28-47cf-a08e-bf52cda019bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:41.932876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc079dd1-0a28-47cf-a08e-bf52cda019bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:41.934382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc079dd1-0a28-47cf-a08e-bf52cda019bb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-dc079dd1-0a28-47cf-a08e-bf52cda019bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:41.948886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:41.949913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:41.950884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 269/539] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 21 21:08:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:41.955795 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca6677-d559-4cbf-bdb9-d5df74d81d05 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:41.962572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604840f-7a49-4639-9e71-a1cc585f0bd5 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:41.962854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604840f-7a49-4639-9e71-a1cc585f0bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:41.963127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604840f-7a49-4639-9e71-a1cc585f0bd5 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:41.965721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 270/540] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:08:41.970143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c8cec-9888-48d7-9273-c4b9cb8939e6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:41.970433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c8cec-9888-48d7-9273-c4b9cb8939e6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:41.970688 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c8cec-9888-48d7-9273-c4b9cb8939e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.005336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f31c8cec-9888-48d7-9273-c4b9cb8939e6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:42.006588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f31c8cec-9888-48d7-9273-c4b9cb8939e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:42.022464 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:42.095784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca6677-d559-4cbf-bdb9-d5df74d81d05 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:42.096745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 271/541] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 21 21:08:42.098398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d7969-2a96-4d97-be9e-81da9c848446 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:42.098874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d7969-2a96-4d97-be9e-81da9c848446 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:42.099313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d7969-2a96-4d97-be9e-81da9c848446 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.100826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 272/542] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:42.112896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0f82-db2d-4ba8-ab76-ae3cbc960869 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:42.113394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0f82-db2d-4ba8-ab76-ae3cbc960869 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:42.113830 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0f82-db2d-4ba8-ab76-ae3cbc960869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.134593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee425fe7-0478-483f-a9bd-065b870f74a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:42.135210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee425fe7-0478-483f-a9bd-065b870f74a1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:42.135536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee425fe7-0478-483f-a9bd-065b870f74a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:42.136097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee425fe7-0478-483f-a9bd-065b870f74a1 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.136845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee425fe7-0478-483f-a9bd-065b870f74a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:42.137161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee425fe7-0478-483f-a9bd-065b870f74a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:42.138584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee425fe7-0478-483f-a9bd-065b870f74a1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:42.141040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0fee0f82-db2d-4ba8-ab76-ae3cbc960869 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:42.142361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0fee0f82-db2d-4ba8-ab76-ae3cbc960869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:42.160609 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 271/543] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 21 21:08:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:42.167242 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee425fe7-0478-483f-a9bd-065b870f74a1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:42.226165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 273/544] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:42.231407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:42.276855 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee425fe7-0478-483f-a9bd-065b870f74a1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:42.312163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1683f-25b5-4594-a10a-83350fffa433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:42.312846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1683f-25b5-4594-a10a-83350fffa433 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:42.313130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1683f-25b5-4594-a10a-83350fffa433 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:42.313411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1683f-25b5-4594-a10a-83350fffa433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.389130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1683f-25b5-4594-a10a-83350fffa433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:42.390500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1683f-25b5-4594-a10a-83350fffa433 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:42.403989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee0f82-db2d-4ba8-ab76-ae3cbc960869 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:42.448404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:42.498044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 272/545] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:42 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 21 21:08:42.500137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8defb6-017d-4d74-b708-7e9a86546f10 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:42.500424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8defb6-017d-4d74-b708-7e9a86546f10 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:42.500700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8defb6-017d-4d74-b708-7e9a86546f10 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.503504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 273/546] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:42.504421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8defb6-017d-4d74-b708-7e9a86546f10 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:42.549811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:42.571763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee0f82-db2d-4ba8-ab76-ae3cbc960869 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:42.605890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1a2e5-0845-4600-992d-46a2a63582b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:42.606537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1a2e5-0845-4600-992d-46a2a63582b1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:42.606798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1a2e5-0845-4600-992d-46a2a63582b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:42.607072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1a2e5-0845-4600-992d-46a2a63582b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.617065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1a2e5-0845-4600-992d-46a2a63582b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-9fa1a2e5-0845-4600-992d-46a2a63582b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:42.621834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:42.622717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:42.623626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 274/547] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:08:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:42.624823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce338b-29b4-4cae-b509-e635bdd3b7dd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:42.624823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce338b-29b4-4cae-b509-e635bdd3b7dd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:42.625054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce338b-29b4-4cae-b509-e635bdd3b7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.632862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8defb6-017d-4d74-b708-7e9a86546f10 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:42.646555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2fce338b-29b4-4cae-b509-e635bdd3b7dd None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:42.647706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2fce338b-29b4-4cae-b509-e635bdd3b7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:42.672027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a162bc-72c1-4a0b-af23-84b79143c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:42.673109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a162bc-72c1-4a0b-af23-84b79143c665 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:42.673590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a162bc-72c1-4a0b-af23-84b79143c665 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:42.674059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a162bc-72c1-4a0b-af23-84b79143c665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.686259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a162bc-72c1-4a0b-af23-84b79143c665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:42.688049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a162bc-72c1-4a0b-af23-84b79143c665 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-95a162bc-72c1-4a0b-af23-84b79143c665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:42.706253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:42.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:42.708552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:42.708552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:42.708552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:42.714503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 274/548] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:42.715538 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a162bc-72c1-4a0b-af23-84b79143c665 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:42.723292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 275/549] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 21 21:08:42.723292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce338b-29b4-4cae-b509-e635bdd3b7dd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:42.737425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:42.787314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:42.826545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce338b-29b4-4cae-b509-e635bdd3b7dd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:42.861332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a162bc-72c1-4a0b-af23-84b79143c665 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:42.861601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9adaab-40f6-401a-a621-a56b6c6610d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:42.862851 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9adaab-40f6-401a-a621-a56b6c6610d2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:42.863234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9adaab-40f6-401a-a621-a56b6c6610d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:42.863628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9adaab-40f6-401a-a621-a56b6c6610d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.864401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9adaab-40f6-401a-a621-a56b6c6610d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:42.864806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9adaab-40f6-401a-a621-a56b6c6610d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:42.866286 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9adaab-40f6-401a-a621-a56b6c6610d2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:42.879644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 276/550] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:42.880651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9adaab-40f6-401a-a621-a56b6c6610d2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:42.902914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073d1f5-cbb4-4829-82e7-a5e715a5bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:42.903528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073d1f5-cbb4-4829-82e7-a5e715a5bb9b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:42.903816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073d1f5-cbb4-4829-82e7-a5e715a5bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:42.904632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073d1f5-cbb4-4829-82e7-a5e715a5bb9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:42.920012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073d1f5-cbb4-4829-82e7-a5e715a5bb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-3073d1f5-cbb4-4829-82e7-a5e715a5bb9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:42.926986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:42.928150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 275/551] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:42.929348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073d1f5-cbb4-4829-82e7-a5e715a5bb9b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.004699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9adaab-40f6-401a-a621-a56b6c6610d2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.009041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:43.034327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:43.040518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27435ea-b5fc-4b18-a105-5be6f23ed01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.041124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27435ea-b5fc-4b18-a105-5be6f23ed01c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.041406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27435ea-b5fc-4b18-a105-5be6f23ed01c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.041677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27435ea-b5fc-4b18-a105-5be6f23ed01c None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.042319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27435ea-b5fc-4b18-a105-5be6f23ed01c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:43.042618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27435ea-b5fc-4b18-a105-5be6f23ed01c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:43.044008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27435ea-b5fc-4b18-a105-5be6f23ed01c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:43.045851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073d1f5-cbb4-4829-82e7-a5e715a5bb9b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.063309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 277/552] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:43.063309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27435ea-b5fc-4b18-a105-5be6f23ed01c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.091703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b8406-fa26-4145-855d-c86c82730328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.092356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b8406-fa26-4145-855d-c86c82730328 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.092637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b8406-fa26-4145-855d-c86c82730328 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.092909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b8406-fa26-4145-855d-c86c82730328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.106430 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b8406-fa26-4145-855d-c86c82730328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:43.107941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b8406-fa26-4145-855d-c86c82730328 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-bc3b8406-fa26-4145-855d-c86c82730328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:43.123777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:43.124765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:43.125704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:43.125704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:43.125704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:43.125704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 276/553] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:43.126517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b8406-fa26-4145-855d-c86c82730328 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.174055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27435ea-b5fc-4b18-a105-5be6f23ed01c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.212440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54ad13-5b27-4656-af0d-1e292d553ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.213043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54ad13-5b27-4656-af0d-1e292d553ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.213325 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54ad13-5b27-4656-af0d-1e292d553ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.213680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54ad13-5b27-4656-af0d-1e292d553ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.214242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54ad13-5b27-4656-af0d-1e292d553ee6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:43.214544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54ad13-5b27-4656-af0d-1e292d553ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:43.215932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54ad13-5b27-4656-af0d-1e292d553ee6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:43.224451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 278/554] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:43.225230 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54ad13-5b27-4656-af0d-1e292d553ee6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.241881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b8406-fa26-4145-855d-c86c82730328 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.262398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:43.278091 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d3b65-aaf0-48f6-b3a0-c070e21b909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.278700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d3b65-aaf0-48f6-b3a0-c070e21b909e None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.278981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d3b65-aaf0-48f6-b3a0-c070e21b909e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.279257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d3b65-aaf0-48f6-b3a0-c070e21b909e None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.279928 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d3b65-aaf0-48f6-b3a0-c070e21b909e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:43.280634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:43.281764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d3b65-aaf0-48f6-b3a0-c070e21b909e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:43.308255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 277/555] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:08:43 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:43.308255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d3b65-aaf0-48f6-b3a0-c070e21b909e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.347639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54ad13-5b27-4656-af0d-1e292d553ee6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.394004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b393e-36e4-44b1-92eb-8e0ec8297451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.395042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b393e-36e4-44b1-92eb-8e0ec8297451 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.396056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b393e-36e4-44b1-92eb-8e0ec8297451 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.396494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b393e-36e4-44b1-92eb-8e0ec8297451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.405718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b393e-36e4-44b1-92eb-8e0ec8297451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:43.408547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b393e-36e4-44b1-92eb-8e0ec8297451 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-836b393e-36e4-44b1-92eb-8e0ec8297451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:43.422783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:43.423955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:43.425123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:43.425123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:43.425123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:43.425123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:43.425123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:43.425123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:43.425123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:43.425123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:43.427210 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 279/556] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:43.428306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b393e-36e4-44b1-92eb-8e0ec8297451 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.438451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d3b65-aaf0-48f6-b3a0-c070e21b909e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.479510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115930e-dbe2-42ab-a447-336687cd0270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.480281 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115930e-dbe2-42ab-a447-336687cd0270 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.480669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115930e-dbe2-42ab-a447-336687cd0270 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.481048 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115930e-dbe2-42ab-a447-336687cd0270 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.481834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115930e-dbe2-42ab-a447-336687cd0270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:43.482246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115930e-dbe2-42ab-a447-336687cd0270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:43.483909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115930e-dbe2-42ab-a447-336687cd0270 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:43.501812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 278/557] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:43.503407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115930e-dbe2-42ab-a447-336687cd0270 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.553496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b393e-36e4-44b1-92eb-8e0ec8297451 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.558378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:43.562816 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:43.592727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0770-e897-47d9-ab13-27373228d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.593392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0770-e897-47d9-ab13-27373228d28a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.593672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0770-e897-47d9-ab13-27373228d28a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.593949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0770-e897-47d9-ab13-27373228d28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.605023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b0770-e897-47d9-ab13-27373228d28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:43.606514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b0770-e897-47d9-ab13-27373228d28a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-5f3b0770-e897-47d9-ab13-27373228d28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:43.621769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:43.622732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:43.623677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:43.623677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:43.623677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:43.623677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 280/558] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:43.624532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0770-e897-47d9-ab13-27373228d28a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.635771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115930e-dbe2-42ab-a447-336687cd0270 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.672668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f68e5-a40d-4ac6-b160-172cd00b8077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.673664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f68e5-a40d-4ac6-b160-172cd00b8077 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.674719 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f68e5-a40d-4ac6-b160-172cd00b8077 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.675339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f68e5-a40d-4ac6-b160-172cd00b8077 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.676249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f68e5-a40d-4ac6-b160-172cd00b8077 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:43.676751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f68e5-a40d-4ac6-b160-172cd00b8077 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:43.678557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f68e5-a40d-4ac6-b160-172cd00b8077 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:43.696646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 279/559] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:43.697986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f68e5-a40d-4ac6-b160-172cd00b8077 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.744639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0770-e897-47d9-ab13-27373228d28a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.798473 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726a72b-c81c-43e3-befd-4d19e280edae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.799673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726a72b-c81c-43e3-befd-4d19e280edae None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.799942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726a72b-c81c-43e3-befd-4d19e280edae None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.800218 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726a72b-c81c-43e3-befd-4d19e280edae None admin] PATH_INFO: `/v3/users/swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.810022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726a72b-c81c-43e3-befd-4d19e280edae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:43.812227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726a72b-c81c-43e3-befd-4d19e280edae None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:43.816494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:43.820395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f68e5-a40d-4ac6-b160-172cd00b8077 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-0726a72b-c81c-43e3-befd-4d19e280edae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:43.830314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:43.831335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:43.832285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:43.832285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:43.832285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:43.832285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:43.832285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:43.832285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:43.832285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:43.832285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:43.832285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 21 21:08:43.832285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:43.838272 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 281/560] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:08:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:43.838272 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726a72b-c81c-43e3-befd-4d19e280edae None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.862782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:43.876903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175276b-a2ba-47c4-801b-daacc5f9fa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.878845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175276b-a2ba-47c4-801b-daacc5f9fa6a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.879373 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175276b-a2ba-47c4-801b-daacc5f9fa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.879847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175276b-a2ba-47c4-801b-daacc5f9fa6a None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.880720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175276b-a2ba-47c4-801b-daacc5f9fa6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:43.881222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175276b-a2ba-47c4-801b-daacc5f9fa6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:43.883378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175276b-a2ba-47c4-801b-daacc5f9fa6a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:43.899573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 280/561] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:43.901166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175276b-a2ba-47c4-801b-daacc5f9fa6a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:43.958500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726a72b-c81c-43e3-befd-4d19e280edae None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:43.996911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fbf52-5e57-406b-b099-16f4efeb8138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:43.997957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbf52-5e57-406b-b099-16f4efeb8138 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:43.998438 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbf52-5e57-406b-b099-16f4efeb8138 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:43.998910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbf52-5e57-406b-b099-16f4efeb8138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:43.999966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fbf52-5e57-406b-b099-16f4efeb8138 None admin] RBAC: Adding query filter params (role.id=58b61e8083c64fd58b3eb63efc4c7e3e, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=8afe54a4c63b4a50a6240293e2be6450) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:44.000489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fbf52-5e57-406b-b099-16f4efeb8138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:44.002152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fbf52-5e57-406b-b099-16f4efeb8138 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:44.009210 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 282/562] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:08:43 2022] GET /identity/v3/role_assignments?user.id=8afe54a4c63b4a50a6240293e2be6450&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=58b61e8083c64fd58b3eb63efc4c7e3e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:44.009840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175276b-a2ba-47c4-801b-daacc5f9fa6a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:44.010505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fbf52-5e57-406b-b099-16f4efeb8138 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:44.082361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f222ca-191a-4c90-971f-d5d41f14c7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:44.082993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f222ca-191a-4c90-971f-d5d41f14c7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:44.083301 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f222ca-191a-4c90-971f-d5d41f14c7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:44.083586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f222ca-191a-4c90-971f-d5d41f14c7f8 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:44.084324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f222ca-191a-4c90-971f-d5d41f14c7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:44.084638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f222ca-191a-4c90-971f-d5d41f14c7f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:44.086109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f222ca-191a-4c90-971f-d5d41f14c7f8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:44.118389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:44.125506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 281/563] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 21 21:08:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:44.132765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f222ca-191a-4c90-971f-d5d41f14c7f8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:44.144798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fbf52-5e57-406b-b099-16f4efeb8138 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:44.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:44.186568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c2804-8884-402e-b674-6f8fa2abaf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:44.187630 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c2804-8884-402e-b674-6f8fa2abaf99 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:44.188114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c2804-8884-402e-b674-6f8fa2abaf99 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:44.188725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c2804-8884-402e-b674-6f8fa2abaf99 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:44.197839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c2804-8884-402e-b674-6f8fa2abaf99 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:44.199970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c2804-8884-402e-b674-6f8fa2abaf99 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-4d9c2804-8884-402e-b674-6f8fa2abaf99 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:44.213240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:44.214224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:44.215180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:44.215180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:44.215180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:44.215180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:44.215180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:44.215180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:44.215180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:44.215180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:44.215180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 21 21:08:44.215180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:44.217671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 283/564] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 21 21:08:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:44.224070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c2804-8884-402e-b674-6f8fa2abaf99 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:44.278638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f222ca-191a-4c90-971f-d5d41f14c7f8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:44.327599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1451f-0ea2-47d2-b1c0-1fa34c79ede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:44.328373 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1451f-0ea2-47d2-b1c0-1fa34c79ede7 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:44.328659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1451f-0ea2-47d2-b1c0-1fa34c79ede7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:44.328932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1451f-0ea2-47d2-b1c0-1fa34c79ede7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:44.353030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1451f-0ea2-47d2-b1c0-1fa34c79ede7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:44.354664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1451f-0ea2-47d2-b1c0-1fa34c79ede7 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:44.373711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c2804-8884-402e-b674-6f8fa2abaf99 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-c5d1451f-0ea2-47d2-b1c0-1fa34c79ede7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:44.376780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:44.377751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:44.378636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:44.378636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:44.378636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:44.379225 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 282/565] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:44.384510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1451f-0ea2-47d2-b1c0-1fa34c79ede7 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:44.422922 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306aec5-1c18-44bf-8928-7b2d88b9a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:44.423640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306aec5-1c18-44bf-8928-7b2d88b9a3ed None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:44.423842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306aec5-1c18-44bf-8928-7b2d88b9a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:44.424138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306aec5-1c18-44bf-8928-7b2d88b9a3ed None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:44.424874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306aec5-1c18-44bf-8928-7b2d88b9a3ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:44.425187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306aec5-1c18-44bf-8928-7b2d88b9a3ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:44.426624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306aec5-1c18-44bf-8928-7b2d88b9a3ed None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:44.446822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 284/566] 10.222.0.23 () {56 vars in 1149 bytes} [Fri Oct 21 21:08:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:44.448266 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135605-bad1-4bb5-9c17-0ecb7ea16c99 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:44.448554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135605-bad1-4bb5-9c17-0ecb7ea16c99 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:44.449098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135605-bad1-4bb5-9c17-0ecb7ea16c99 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:44.450452 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 285/567] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:44.453429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5135605-bad1-4bb5-9c17-0ecb7ea16c99 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:44.457296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:44.488736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:44.520867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1451f-0ea2-47d2-b1c0-1fa34c79ede7 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:44.565994 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580294ba-5670-44b7-9116-6cfc2b85cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:44.566614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580294ba-5670-44b7-9116-6cfc2b85cc4a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:44.566932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580294ba-5670-44b7-9116-6cfc2b85cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:44.567218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580294ba-5670-44b7-9116-6cfc2b85cc4a None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:44.567964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580294ba-5670-44b7-9116-6cfc2b85cc4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:44.568273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580294ba-5670-44b7-9116-6cfc2b85cc4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:44.570435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580294ba-5670-44b7-9116-6cfc2b85cc4a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:44.573120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5135605-bad1-4bb5-9c17-0ecb7ea16c99 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:44.584131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 283/568] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:44.585489 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa1b67-600d-4cf2-beaa-407bea7f9255 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:44.585777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa1b67-600d-4cf2-beaa-407bea7f9255 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:44.586049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa1b67-600d-4cf2-beaa-407bea7f9255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:44.607020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-affa1b67-600d-4cf2-beaa-407bea7f9255 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:44.608323 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-affa1b67-600d-4cf2-beaa-407bea7f9255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:44.616872 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01160815-7d48-4a57-a49c-92fb8b05deef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:44.617510 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160815-7d48-4a57-a49c-92fb8b05deef None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:44.617849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160815-7d48-4a57-a49c-92fb8b05deef None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:44.618125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01160815-7d48-4a57-a49c-92fb8b05deef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:44.629923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01160815-7d48-4a57-a49c-92fb8b05deef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:44.631485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01160815-7d48-4a57-a49c-92fb8b05deef None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-01160815-7d48-4a57-a49c-92fb8b05deef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:44.648665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:44.649644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:44.650545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:44.650545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:44.650545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:44.654397 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 286/569] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:44.655522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01160815-7d48-4a57-a49c-92fb8b05deef None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:44.681999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 284/570] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:08:44.682852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa1b67-600d-4cf2-beaa-407bea7f9255 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:44.748766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:44.765752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:44.809562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa1b67-600d-4cf2-beaa-407bea7f9255 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:44.826742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01160815-7d48-4a57-a49c-92fb8b05deef None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:44.851533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070a444-15de-459c-a43a-28ede8fdfe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:44.852145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070a444-15de-459c-a43a-28ede8fdfe5c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:44.852423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070a444-15de-459c-a43a-28ede8fdfe5c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:44.852699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070a444-15de-459c-a43a-28ede8fdfe5c None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:44.853341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070a444-15de-459c-a43a-28ede8fdfe5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:44.853643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070a444-15de-459c-a43a-28ede8fdfe5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:44.855020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070a444-15de-459c-a43a-28ede8fdfe5c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:44.877316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 285/571] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:44.882360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070a444-15de-459c-a43a-28ede8fdfe5c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:44.899437 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205b1ce-2b1f-4b12-bdf4-275ecf9583b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:44.900071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205b1ce-2b1f-4b12-bdf4-275ecf9583b9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:44.900354 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205b1ce-2b1f-4b12-bdf4-275ecf9583b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:44.900629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205b1ce-2b1f-4b12-bdf4-275ecf9583b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:44.913152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205b1ce-2b1f-4b12-bdf4-275ecf9583b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:44.914591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205b1ce-2b1f-4b12-bdf4-275ecf9583b9 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-1205b1ce-2b1f-4b12-bdf4-275ecf9583b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:44.937322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:44.939442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:44.941654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:44.941654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:44.941654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:44.941654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:44.941654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:44.941654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:44.941654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:44.941654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:44.941654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 287/572] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:44.946342 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205b1ce-2b1f-4b12-bdf4-275ecf9583b9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:45.015799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070a444-15de-459c-a43a-28ede8fdfe5c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:45.037508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:45.072099 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a742d86-7167-42ed-9b98-f9a94f437d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:45.072786 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a742d86-7167-42ed-9b98-f9a94f437d4e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:45.073058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a742d86-7167-42ed-9b98-f9a94f437d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:45.073345 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a742d86-7167-42ed-9b98-f9a94f437d4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:45.085567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a742d86-7167-42ed-9b98-f9a94f437d4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:45.088340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a742d86-7167-42ed-9b98-f9a94f437d4e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-5a742d86-7167-42ed-9b98-f9a94f437d4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:45.105343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:45.106296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:45.107195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:45.107195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:45.107195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:45.107195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:45.107195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:45.107195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:45.107195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:45.107195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:45.111329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 286/573] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:45.111329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a742d86-7167-42ed-9b98-f9a94f437d4e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:45.125442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205b1ce-2b1f-4b12-bdf4-275ecf9583b9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:45.140000 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:45.163725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d4a9f-72a3-4cc6-9dd6-9e6e7888e367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:45.164572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4a9f-72a3-4cc6-9dd6-9e6e7888e367 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:45.164996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4a9f-72a3-4cc6-9dd6-9e6e7888e367 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:45.165399 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d4a9f-72a3-4cc6-9dd6-9e6e7888e367 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:45.166304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d4a9f-72a3-4cc6-9dd6-9e6e7888e367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:45.166824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d4a9f-72a3-4cc6-9dd6-9e6e7888e367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:45.168460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d4a9f-72a3-4cc6-9dd6-9e6e7888e367 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:45.184028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 288/574] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:45.185129 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d4a9f-72a3-4cc6-9dd6-9e6e7888e367 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:45.233636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a742d86-7167-42ed-9b98-f9a94f437d4e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:45.269325 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa092e1-fbb5-4054-953c-7fa96a07347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:45.270100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa092e1-fbb5-4054-953c-7fa96a07347a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:45.270339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa092e1-fbb5-4054-953c-7fa96a07347a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:45.270615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa092e1-fbb5-4054-953c-7fa96a07347a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:45.271201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa092e1-fbb5-4054-953c-7fa96a07347a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:45.272618 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa092e1-fbb5-4054-953c-7fa96a07347a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-dfa092e1-fbb5-4054-953c-7fa96a07347a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:45.281686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:45.282761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 21 21:08:45.284210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:45.288655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 287/575] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Oct 21 21:08:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:45.289199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa092e1-fbb5-4054-953c-7fa96a07347a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:45.298238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d4a9f-72a3-4cc6-9dd6-9e6e7888e367 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:45.337277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92ad0a-4110-4ad7-94f0-256156183d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:45.338316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ad0a-4110-4ad7-94f0-256156183d50 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:45.338797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ad0a-4110-4ad7-94f0-256156183d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:45.339342 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ad0a-4110-4ad7-94f0-256156183d50 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:45.340213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:45.340899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92ad0a-4110-4ad7-94f0-256156183d50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:45.341427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92ad0a-4110-4ad7-94f0-256156183d50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:45.343873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92ad0a-4110-4ad7-94f0-256156183d50 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:45.358895 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 289/576] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:45.360004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92ad0a-4110-4ad7-94f0-256156183d50 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:45.407465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:45.420392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa092e1-fbb5-4054-953c-7fa96a07347a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:45.463713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be127b91-1e54-4621-942b-2c3e177b8aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:45.464680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be127b91-1e54-4621-942b-2c3e177b8aa6 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:45.465424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be127b91-1e54-4621-942b-2c3e177b8aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:45.466174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be127b91-1e54-4621-942b-2c3e177b8aa6 None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/e2dc36f09ae941ecbf30ff11475e7f74/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:45.468497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be127b91-1e54-4621-942b-2c3e177b8aa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=e2dc36f09ae941ecbf30ff11475e7f74, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:45.470907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be127b91-1e54-4621-942b-2c3e177b8aa6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:45.499220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92ad0a-4110-4ad7-94f0-256156183d50 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:45.499750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 288/577] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:08:45 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/e2dc36f09ae941ecbf30ff11475e7f74/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:45.499750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be127b91-1e54-4621-942b-2c3e177b8aa6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:45.571292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa3a71-8249-4a82-b86d-b7bf037c707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:45.572967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa3a71-8249-4a82-b86d-b7bf037c707c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:45.574893 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa3a71-8249-4a82-b86d-b7bf037c707c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:45.575199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa3a71-8249-4a82-b86d-b7bf037c707c None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:45.575892 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa3a71-8249-4a82-b86d-b7bf037c707c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:45.576198 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa3a71-8249-4a82-b86d-b7bf037c707c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:45.581975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa3a71-8249-4a82-b86d-b7bf037c707c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:45.592430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 290/578] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 21 21:08:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:45.601114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa3a71-8249-4a82-b86d-b7bf037c707c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:45.722494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be127b91-1e54-4621-942b-2c3e177b8aa6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:45.726223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:45.764809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed00222-9f1f-44dc-a4d6-543b4b0059ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:45.765482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed00222-9f1f-44dc-a4d6-543b4b0059ee None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:45.765761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed00222-9f1f-44dc-a4d6-543b4b0059ee None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:45.766036 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed00222-9f1f-44dc-a4d6-543b4b0059ee None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/0f67502c08b84cee80f57eb194fb731b/roles/9551be8340204b80958e4788f306cff6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:45.766549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:45.771039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa3a71-8249-4a82-b86d-b7bf037c707c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:45.781853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed00222-9f1f-44dc-a4d6-543b4b0059ee None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=0f67502c08b84cee80f57eb194fb731b, role_id=9551be8340204b80958e4788f306cff6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:45.783346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed00222-9f1f-44dc-a4d6-543b4b0059ee None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:45.803498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 289/579] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:08:45 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/0f67502c08b84cee80f57eb194fb731b/roles/9551be8340204b80958e4788f306cff6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:45.805928 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54cdd-8c22-4acf-b815-618ac0b8a203 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:45.806211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54cdd-8c22-4acf-b815-618ac0b8a203 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:45.806486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54cdd-8c22-4acf-b815-618ac0b8a203 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:45.810640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 290/580] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:45.813281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecfaf0-8f74-4179-be4b-cd4b28292721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:45.816279 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecfaf0-8f74-4179-be4b-cd4b28292721 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:45.816555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecfaf0-8f74-4179-be4b-cd4b28292721 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:45.816840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecfaf0-8f74-4179-be4b-cd4b28292721 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:45.817007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea165-5f11-4e0a-9831-3913b93475de None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:45.817247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea165-5f11-4e0a-9831-3913b93475de None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:45.817520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea165-5f11-4e0a-9831-3913b93475de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:45.820164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecfaf0-8f74-4179-be4b-cd4b28292721 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:45.820485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecfaf0-8f74-4179-be4b-cd4b28292721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:45.822941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecfaf0-8f74-4179-be4b-cd4b28292721 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:45.839910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 291/581] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 21 21:08:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:45.842863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecfaf0-8f74-4179-be4b-cd4b28292721 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:45.861006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-29cea165-5f11-4e0a-9831-3913b93475de None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:45.863182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-29cea165-5f11-4e0a-9831-3913b93475de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:46.011579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 291/582] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:08:46.046396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecfaf0-8f74-4179-be4b-cd4b28292721 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:46.087514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a20636-01d9-4ac0-be55-f3b0015d1200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:46.088052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a20636-01d9-4ac0-be55-f3b0015d1200 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:46.088331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a20636-01d9-4ac0-be55-f3b0015d1200 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:46.088603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a20636-01d9-4ac0-be55-f3b0015d1200 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:46.089305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a20636-01d9-4ac0-be55-f3b0015d1200 None admin] RBAC: Adding query filter params (interface=public, service_id=f5b1b800995d42e5b1d8b8d18aa3fcc8, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:46.089609 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a20636-01d9-4ac0-be55-f3b0015d1200 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:46.090963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a20636-01d9-4ac0-be55-f3b0015d1200 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:46.099791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 292/583] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 21 21:08:45 2022] GET /identity/v3/endpoints?service_id=f5b1b800995d42e5b1d8b8d18aa3fcc8&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:46.105166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea165-5f11-4e0a-9831-3913b93475de None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:46.207284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:46.225115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea165-5f11-4e0a-9831-3913b93475de None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:46.264613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e92223-4d17-44ea-9448-579507419169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:46.265238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e92223-4d17-44ea-9448-579507419169 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:46.265524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e92223-4d17-44ea-9448-579507419169 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:46.265803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e92223-4d17-44ea-9448-579507419169 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:46.266417 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e92223-4d17-44ea-9448-579507419169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:46.267853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e92223-4d17-44ea-9448-579507419169 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:46.273614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 292/584] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 21 21:08:46 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:46.336895 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a20636-01d9-4ac0-be55-f3b0015d1200 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:46.384480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:46.468299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a20636-01d9-4ac0-be55-f3b0015d1200 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:46.509393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58282493-b075-4c1e-beda-14d87ed18c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:46.510812 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282493-b075-4c1e-beda-14d87ed18c17 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:46.511307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282493-b075-4c1e-beda-14d87ed18c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:46.511797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282493-b075-4c1e-beda-14d87ed18c17 None admin] PATH_INFO: `/v3/services/network` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:46.512573 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282493-b075-4c1e-beda-14d87ed18c17 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:46.514143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282493-b075-4c1e-beda-14d87ed18c17 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-58282493-b075-4c1e-beda-14d87ed18c17 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:46.524967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:46.526092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 21 21:08:46.527001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:46.534965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 293/585] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:46 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:46.536823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e92223-4d17-44ea-9448-579507419169 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:46.652256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e92223-4d17-44ea-9448-579507419169 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:46.657971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd3249-f707-475d-9e53-01c5f79ae40b None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:46.658252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd3249-f707-475d-9e53-01c5f79ae40b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:46.658556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd3249-f707-475d-9e53-01c5f79ae40b None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:46.660172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 294/586] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:08:46.665610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db3e2-5460-4909-a872-33328ad2ff3a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:46.665894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db3e2-5460-4909-a872-33328ad2ff3a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:46.666169 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1db3e2-5460-4909-a872-33328ad2ff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:46.685212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-db1db3e2-5460-4909-a872-33328ad2ff3a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:46.686406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-db1db3e2-5460-4909-a872-33328ad2ff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:46.692853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd755185-ccbd-4503-a39a-21797b91abc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:46.693740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd755185-ccbd-4503-a39a-21797b91abc8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:46.694245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd755185-ccbd-4503-a39a-21797b91abc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:46.694726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd755185-ccbd-4503-a39a-21797b91abc8 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:46.695584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd755185-ccbd-4503-a39a-21797b91abc8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:46.696085 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd755185-ccbd-4503-a39a-21797b91abc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:46.697630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd755185-ccbd-4503-a39a-21797b91abc8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:46.709582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 293/587] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:08:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:46.711100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd755185-ccbd-4503-a39a-21797b91abc8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:46.736390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:46.793681 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 295/588] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:08:46.863670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd755185-ccbd-4503-a39a-21797b91abc8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:46.909250 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad937-e5ec-46ab-9f48-3d52538a92fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:46.910234 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad937-e5ec-46ab-9f48-3d52538a92fd None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:46.910762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad937-e5ec-46ab-9f48-3d52538a92fd None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:46.911237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad937-e5ec-46ab-9f48-3d52538a92fd None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:46.912161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad937-e5ec-46ab-9f48-3d52538a92fd None admin] RBAC: Adding query filter params (type=network) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:46.912680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad937-e5ec-46ab-9f48-3d52538a92fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:46.914267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad937-e5ec-46ab-9f48-3d52538a92fd None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:46.923444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 294/589] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:08:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:46.927158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1db3e2-5460-4909-a872-33328ad2ff3a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:46.958628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:47.043383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1db3e2-5460-4909-a872-33328ad2ff3a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:47.085443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba8b2b-4a85-4c39-8f39-0f6f39b1bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:47.086064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba8b2b-4a85-4c39-8f39-0f6f39b1bf88 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:47.086343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba8b2b-4a85-4c39-8f39-0f6f39b1bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:47.086617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba8b2b-4a85-4c39-8f39-0f6f39b1bf88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:47.087379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba8b2b-4a85-4c39-8f39-0f6f39b1bf88 None admin] RBAC: Adding query filter params (interface=public, service_id=c7b0815ff047442e927e49e02645811a, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:47.087692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba8b2b-4a85-4c39-8f39-0f6f39b1bf88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:47.089099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba8b2b-4a85-4c39-8f39-0f6f39b1bf88 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:47.099050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 296/590] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 21 21:08:46 2022] GET /identity/v3/endpoints?service_id=c7b0815ff047442e927e49e02645811a&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:47.104718 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad937-e5ec-46ab-9f48-3d52538a92fd None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:47.190520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:47.214979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad937-e5ec-46ab-9f48-3d52538a92fd None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:47.250573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8046ef-54c7-4f8e-8309-ef4c8f1a73c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:47.251187 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8046ef-54c7-4f8e-8309-ef4c8f1a73c0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:47.251502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8046ef-54c7-4f8e-8309-ef4c8f1a73c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:47.251778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8046ef-54c7-4f8e-8309-ef4c8f1a73c0 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:47.252413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8046ef-54c7-4f8e-8309-ef4c8f1a73c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:47.253777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8046ef-54c7-4f8e-8309-ef4c8f1a73c0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:47.259237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 295/591] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 21 21:08:47 2022] GET /identity/v3/services => generated 772 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:47.277520 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba8b2b-4a85-4c39-8f39-0f6f39b1bf88 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:47.420684 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:47.451289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba8b2b-4a85-4c39-8f39-0f6f39b1bf88 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:47.500813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731aa99-2412-41e8-8e88-7359c69e2af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:47.501448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731aa99-2412-41e8-8e88-7359c69e2af9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:47.501730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731aa99-2412-41e8-8e88-7359c69e2af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:47.502006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731aa99-2412-41e8-8e88-7359c69e2af9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:47.503144 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731aa99-2412-41e8-8e88-7359c69e2af9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:47.504552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731aa99-2412-41e8-8e88-7359c69e2af9 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-5731aa99-2412-41e8-8e88-7359c69e2af9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:47.513590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:47.515007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 21 21:08:47.515993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:47.516779 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 297/592] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Oct 21 21:08:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:47.523138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8046ef-54c7-4f8e-8309-ef4c8f1a73c0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:47.635870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8046ef-54c7-4f8e-8309-ef4c8f1a73c0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:47.671213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ebc5b-795d-4225-8756-63d322aef5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:47.671846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ebc5b-795d-4225-8756-63d322aef5ef None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:47.672124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ebc5b-795d-4225-8756-63d322aef5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:47.672397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ebc5b-795d-4225-8756-63d322aef5ef None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:47.673033 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ebc5b-795d-4225-8756-63d322aef5ef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:47.673337 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ebc5b-795d-4225-8756-63d322aef5ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:47.675244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ebc5b-795d-4225-8756-63d322aef5ef None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:47.680055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 296/593] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:08:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:47.686973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731aa99-2412-41e8-8e88-7359c69e2af9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:47.827960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731aa99-2412-41e8-8e88-7359c69e2af9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:47.873841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a02d3-18e2-4456-b024-d11a13ac3be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:47.874451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a02d3-18e2-4456-b024-d11a13ac3be8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:47.874734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a02d3-18e2-4456-b024-d11a13ac3be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:47.875009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a02d3-18e2-4456-b024-d11a13ac3be8 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:47.875679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a02d3-18e2-4456-b024-d11a13ac3be8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:47.875984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a02d3-18e2-4456-b024-d11a13ac3be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:47.877886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a02d3-18e2-4456-b024-d11a13ac3be8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:47.886418 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 298/594] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:08:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:48.182169 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa0e5-d6c0-4ee9-8796-9ed1b274b006 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:48.182549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa0e5-d6c0-4ee9-8796-9ed1b274b006 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:48.182723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa0e5-d6c0-4ee9-8796-9ed1b274b006 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:48.184582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 297/595] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:48.190527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2c109-ed8d-474f-8097-1a174c3b753a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:48.190818 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2c109-ed8d-474f-8097-1a174c3b753a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:48.191099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2c109-ed8d-474f-8097-1a174c3b753a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:48.220339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b2b2c109-ed8d-474f-8097-1a174c3b753a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:48.221576 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b2b2c109-ed8d-474f-8097-1a174c3b753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:48.229536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:48.308005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 299/596] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:08:48.447039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb045b-362f-4ab2-8537-12c79a453e9d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:48.447230 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb045b-362f-4ab2-8537-12c79a453e9d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:48.447552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb045b-362f-4ab2-8537-12c79a453e9d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:48.449296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 298/597] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:48.458276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ec7ed-e3f2-4d11-8056-aeb30d39c88c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:48.458276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ec7ed-e3f2-4d11-8056-aeb30d39c88c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:48.458276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ec7ed-e3f2-4d11-8056-aeb30d39c88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:48.474430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0a5ec7ed-e3f2-4d11-8056-aeb30d39c88c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:48.475962 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0a5ec7ed-e3f2-4d11-8056-aeb30d39c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:48.545071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 300/598] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:08:48.766120 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb045b-362f-4ab2-8537-12c79a453e9d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:48.770699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:48.865914 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ec7ed-e3f2-4d11-8056-aeb30d39c88c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:48.877243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb045b-362f-4ab2-8537-12c79a453e9d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:48.917632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4bd03-fea3-406e-9139-a885d52c0130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:48.918265 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4bd03-fea3-406e-9139-a885d52c0130 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:48.918539 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4bd03-fea3-406e-9139-a885d52c0130 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:48.918811 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4bd03-fea3-406e-9139-a885d52c0130 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:48.941530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4bd03-fea3-406e-9139-a885d52c0130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9dd4bd03-fea3-406e-9139-a885d52c0130 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:48.946412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:48.947407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:08:48.948293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:48.960165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 299/599] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:08:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:48.961673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:48.966216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4bd03-fea3-406e-9139-a885d52c0130 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:48.996585 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ec7ed-e3f2-4d11-8056-aeb30d39c88c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:49.036227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716579d0-73e3-4aa0-b886-f32faa32f7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:49.036786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716579d0-73e3-4aa0-b886-f32faa32f7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.037059 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716579d0-73e3-4aa0-b886-f32faa32f7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.037329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716579d0-73e3-4aa0-b886-f32faa32f7b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.050213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716579d0-73e3-4aa0-b886-f32faa32f7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-716579d0-73e3-4aa0-b886-f32faa32f7b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:49.055719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:49.056674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:49.057813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 301/600] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:08:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:49.065215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716579d0-73e3-4aa0-b886-f32faa32f7b2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:49.119644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:49.169925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4bd03-fea3-406e-9139-a885d52c0130 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:49.212775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716579d0-73e3-4aa0-b886-f32faa32f7b2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:49.217552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6af0d8-3299-4cac-a16b-9a8fbde731da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:49.218231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6af0d8-3299-4cac-a16b-9a8fbde731da None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.218574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6af0d8-3299-4cac-a16b-9a8fbde731da None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.218911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6af0d8-3299-4cac-a16b-9a8fbde731da None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.219674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6af0d8-3299-4cac-a16b-9a8fbde731da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:49.220037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6af0d8-3299-4cac-a16b-9a8fbde731da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:49.221965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6af0d8-3299-4cac-a16b-9a8fbde731da None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:49.233195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 300/601] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:08:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:49.234973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe94476-a38c-4e42-877a-3bc876258fc2 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.235589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe94476-a38c-4e42-877a-3bc876258fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.235931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe94476-a38c-4e42-877a-3bc876258fc2 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.238130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 301/602] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:49.239005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe94476-a38c-4e42-877a-3bc876258fc2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:49.248064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:49.254392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d59be-8568-4d8c-8181-17af4cc534ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:49.255400 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d59be-8568-4d8c-8181-17af4cc534ac None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.255789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d59be-8568-4d8c-8181-17af4cc534ac None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.256160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d59be-8568-4d8c-8181-17af4cc534ac None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.256981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d59be-8568-4d8c-8181-17af4cc534ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:49.257413 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d59be-8568-4d8c-8181-17af4cc534ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:49.258880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d59be-8568-4d8c-8181-17af4cc534ac None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:49.269203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 302/603] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:08:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:49.270635 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19eaf-a53b-4bb3-905f-38535588ff5e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.271028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19eaf-a53b-4bb3-905f-38535588ff5e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.271528 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19eaf-a53b-4bb3-905f-38535588ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.290584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-88d19eaf-a53b-4bb3-905f-38535588ff5e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:49.292397 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-88d19eaf-a53b-4bb3-905f-38535588ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:49.365972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe94476-a38c-4e42-877a-3bc876258fc2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:49.371595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 303/604] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:08:49.372619 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19eaf-a53b-4bb3-905f-38535588ff5e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:49.395532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:49.406686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf4c96-ac42-4c51-867c-9156e75a45ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:49.407719 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf4c96-ac42-4c51-867c-9156e75a45ec None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.408154 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf4c96-ac42-4c51-867c-9156e75a45ec None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.408840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf4c96-ac42-4c51-867c-9156e75a45ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.421576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf4c96-ac42-4c51-867c-9156e75a45ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:49.423366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf4c96-ac42-4c51-867c-9156e75a45ec None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-3ecf4c96-ac42-4c51-867c-9156e75a45ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:49.441505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:49.442549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:49.443485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:49.443485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:49.443485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:49.446094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 302/605] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:49.451650 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf4c96-ac42-4c51-867c-9156e75a45ec None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:49.555302 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19eaf-a53b-4bb3-905f-38535588ff5e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:49.574814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf4c96-ac42-4c51-867c-9156e75a45ec None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:49.607602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:49.627765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43ade9-9be0-401b-925d-263b233d8e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:49.628734 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43ade9-9be0-401b-925d-263b233d8e70 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.629222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43ade9-9be0-401b-925d-263b233d8e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.629702 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43ade9-9be0-401b-925d-263b233d8e70 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.630528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43ade9-9be0-401b-925d-263b233d8e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:49.631028 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43ade9-9be0-401b-925d-263b233d8e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:49.631953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bc3f-b0f6-4bf9-9018-66d9d0fde819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:49.632659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bc3f-b0f6-4bf9-9018-66d9d0fde819 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.632941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bc3f-b0f6-4bf9-9018-66d9d0fde819 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.633215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bc3f-b0f6-4bf9-9018-66d9d0fde819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.633494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43ade9-9be0-401b-925d-263b233d8e70 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:49.649138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 303/606] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:49.659309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57bc3f-b0f6-4bf9-9018-66d9d0fde819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:49.659309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57bc3f-b0f6-4bf9-9018-66d9d0fde819 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:49.660584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43ade9-9be0-401b-925d-263b233d8e70 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-0e57bc3f-b0f6-4bf9-9018-66d9d0fde819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:49.670278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:49.671246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:49.672154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:49.672154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:49.672154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:49.672154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 304/607] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:49.677483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bc3f-b0f6-4bf9-9018-66d9d0fde819 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:49.706812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:49.769072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43ade9-9be0-401b-925d-263b233d8e70 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:49.804651 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969886a6-7035-44c4-bd3b-899ae9030bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:49.805724 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969886a6-7035-44c4-bd3b-899ae9030bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.806154 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969886a6-7035-44c4-bd3b-899ae9030bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.806561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969886a6-7035-44c4-bd3b-899ae9030bf5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.813888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969886a6-7035-44c4-bd3b-899ae9030bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:49.815510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969886a6-7035-44c4-bd3b-899ae9030bf5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-969886a6-7035-44c4-bd3b-899ae9030bf5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:49.827396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:49.828433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:49.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:49.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:49.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:49.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:49.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:49.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:49.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:49.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:49.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 21 21:08:49.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:49.832523 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 304/608] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:08:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:49.833462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969886a6-7035-44c4-bd3b-899ae9030bf5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:49.857063 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bc3f-b0f6-4bf9-9018-66d9d0fde819 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:49.901436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb301b8-43f6-4b4b-8e93-30019b64ae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:49.902174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb301b8-43f6-4b4b-8e93-30019b64ae6d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.902561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb301b8-43f6-4b4b-8e93-30019b64ae6d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.903079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb301b8-43f6-4b4b-8e93-30019b64ae6d None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.904584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb301b8-43f6-4b4b-8e93-30019b64ae6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:49.904982 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb301b8-43f6-4b4b-8e93-30019b64ae6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:49.906429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb301b8-43f6-4b4b-8e93-30019b64ae6d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:49.921659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 305/609] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:49.923061 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb301b8-43f6-4b4b-8e93-30019b64ae6d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:49.931664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:49.937323 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969886a6-7035-44c4-bd3b-899ae9030bf5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:49.973105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:49.977256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04536f6d-3280-48e5-bb3b-39ed8f736049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:49.978284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04536f6d-3280-48e5-bb3b-39ed8f736049 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:49.978765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04536f6d-3280-48e5-bb3b-39ed8f736049 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:49.979255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04536f6d-3280-48e5-bb3b-39ed8f736049 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:49.980118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04536f6d-3280-48e5-bb3b-39ed8f736049 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:49.981800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04536f6d-3280-48e5-bb3b-39ed8f736049 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-04536f6d-3280-48e5-bb3b-39ed8f736049 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:49.991860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:49.992921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 21 21:08:49.993742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:49.996560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 305/610] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Oct 21 21:08:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:49.997539 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04536f6d-3280-48e5-bb3b-39ed8f736049 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:50.066334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb301b8-43f6-4b4b-8e93-30019b64ae6d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:50.106828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04536f6d-3280-48e5-bb3b-39ed8f736049 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:50.107157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915bf93-fbb6-4190-8448-d93b3cf5cb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:50.107807 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bf93-fbb6-4190-8448-d93b3cf5cb23 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.108096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bf93-fbb6-4190-8448-d93b3cf5cb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.108406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bf93-fbb6-4190-8448-d93b3cf5cb23 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.109138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915bf93-fbb6-4190-8448-d93b3cf5cb23 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:50.109447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915bf93-fbb6-4190-8448-d93b3cf5cb23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:50.110863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915bf93-fbb6-4190-8448-d93b3cf5cb23 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:50.129049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 306/611] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Oct 21 21:08:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:50.129722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915bf93-fbb6-4190-8448-d93b3cf5cb23 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:50.152701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b87e5-e8ab-4306-9b42-c15839e59000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:50.153335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b87e5-e8ab-4306-9b42-c15839e59000 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.153619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b87e5-e8ab-4306-9b42-c15839e59000 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.153897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b87e5-e8ab-4306-9b42-c15839e59000 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.162947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b87e5-e8ab-4306-9b42-c15839e59000 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:50.164441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b87e5-e8ab-4306-9b42-c15839e59000 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-485b87e5-e8ab-4306-9b42-c15839e59000 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:50.176339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:50.177324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:50.178251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 306/612] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 21 21:08:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:50.178830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e483697-b39d-45c8-9c78-cb9c4208d602 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.178830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e483697-b39d-45c8-9c78-cb9c4208d602 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.179514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e483697-b39d-45c8-9c78-cb9c4208d602 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.180627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 307/613] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:50.181344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e483697-b39d-45c8-9c78-cb9c4208d602 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:50.210891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:50.240826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:50.248126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915bf93-fbb6-4190-8448-d93b3cf5cb23 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:50.284756 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a37a-8a29-4408-a8e7-fc3321592fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:50.285376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a37a-8a29-4408-a8e7-fc3321592fce None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.285660 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a37a-8a29-4408-a8e7-fc3321592fce None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.286168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a37a-8a29-4408-a8e7-fc3321592fce None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.286556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a37a-8a29-4408-a8e7-fc3321592fce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:50.286859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a37a-8a29-4408-a8e7-fc3321592fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:50.288259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a37a-8a29-4408-a8e7-fc3321592fce None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:50.293476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 307/614] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 21 21:08:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:50.294089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a37a-8a29-4408-a8e7-fc3321592fce None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:50.300667 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e483697-b39d-45c8-9c78-cb9c4208d602 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:50.337032 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8f5e6-4b50-47ca-99fe-cb2cf86dd0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:50.337570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8f5e6-4b50-47ca-99fe-cb2cf86dd0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.337849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8f5e6-4b50-47ca-99fe-cb2cf86dd0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.338123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8f5e6-4b50-47ca-99fe-cb2cf86dd0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.404908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a37a-8a29-4408-a8e7-fc3321592fce None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:50.414079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8f5e6-4b50-47ca-99fe-cb2cf86dd0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:50.416026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8f5e6-4b50-47ca-99fe-cb2cf86dd0d1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:50.439226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b27ca-d4ee-4d57-bffe-1ae4364205b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:50.440076 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b27ca-d4ee-4d57-bffe-1ae4364205b7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.440362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b27ca-d4ee-4d57-bffe-1ae4364205b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.440640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b27ca-d4ee-4d57-bffe-1ae4364205b7 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.441401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b27ca-d4ee-4d57-bffe-1ae4364205b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:50.441709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b27ca-d4ee-4d57-bffe-1ae4364205b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:50.443203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b27ca-d4ee-4d57-bffe-1ae4364205b7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:50.443983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:50.464046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 308/615] 10.222.0.23 () {56 vars in 1149 bytes} [Fri Oct 21 21:08:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:50.470099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43f5f-c45a-45f6-b440-ab1576989d23 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.470464 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43f5f-c45a-45f6-b440-ab1576989d23 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.470676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43f5f-c45a-45f6-b440-ab1576989d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.490500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9de43f5f-c45a-45f6-b440-ab1576989d23 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:50.491794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9de43f5f-c45a-45f6-b440-ab1576989d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:50.505086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:50.531811 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 308/616] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 21 21:08:50.532972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8f5e6-4b50-47ca-99fe-cb2cf86dd0d1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:50.572961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 309/617] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:08:50.574058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43f5f-c45a-45f6-b440-ab1576989d23 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:50.642340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8f5e6-4b50-47ca-99fe-cb2cf86dd0d1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:50.665716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:50.680116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e6293-cfb7-4827-810c-5c1495a1293f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:50.680733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e6293-cfb7-4827-810c-5c1495a1293f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.681012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e6293-cfb7-4827-810c-5c1495a1293f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.681282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e6293-cfb7-4827-810c-5c1495a1293f None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.681907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e6293-cfb7-4827-810c-5c1495a1293f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:50.682209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e6293-cfb7-4827-810c-5c1495a1293f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:50.682432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43f5f-c45a-45f6-b440-ab1576989d23 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:50.683605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e6293-cfb7-4827-810c-5c1495a1293f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:50.693499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 309/618] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Oct 21 21:08:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:50.693499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e6293-cfb7-4827-810c-5c1495a1293f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:50.720733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67e040-f948-419d-95fc-32404e4ed478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:50.722010 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67e040-f948-419d-95fc-32404e4ed478 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.722291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67e040-f948-419d-95fc-32404e4ed478 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.722563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67e040-f948-419d-95fc-32404e4ed478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.738436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:50.791495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67e040-f948-419d-95fc-32404e4ed478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:50.792933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67e040-f948-419d-95fc-32404e4ed478 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:50.797976 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e6293-cfb7-4827-810c-5c1495a1293f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:50.834395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e1ad7-3f18-477e-9f18-9428a2f040b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:50.835027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e1ad7-3f18-477e-9f18-9428a2f040b6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.835339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e1ad7-3f18-477e-9f18-9428a2f040b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.835605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e1ad7-3f18-477e-9f18-9428a2f040b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.847391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e1ad7-3f18-477e-9f18-9428a2f040b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:50.848823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e1ad7-3f18-477e-9f18-9428a2f040b6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-746e1ad7-3f18-477e-9f18-9428a2f040b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:50.863791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:50.865003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:50.866101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:50.866101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:50.866101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:50.871422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 310/619] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:50.871422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c16c0-4d48-4c7d-bef3-b38d007d393b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:50.871422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c16c0-4d48-4c7d-bef3-b38d007d393b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:50.871422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c16c0-4d48-4c7d-bef3-b38d007d393b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:50.871422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 311/620] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:50.871422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c16c0-4d48-4c7d-bef3-b38d007d393b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:50.895152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 310/621] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:08:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 21 21:08:50.895955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67e040-f948-419d-95fc-32404e4ed478 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:50.916485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:50.941328 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:50.977654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c16c0-4d48-4c7d-bef3-b38d007d393b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:50.994339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67e040-f948-419d-95fc-32404e4ed478 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:51.011244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e54689-532f-4f9d-9526-fab235e51500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.011879 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e54689-532f-4f9d-9526-fab235e51500 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.012159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e54689-532f-4f9d-9526-fab235e51500 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.012434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e54689-532f-4f9d-9526-fab235e51500 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.013099 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e54689-532f-4f9d-9526-fab235e51500 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.014456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e54689-532f-4f9d-9526-fab235e51500 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.027927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a8f7a-6625-4779-8c7f-77ae62387e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.028674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a8f7a-6625-4779-8c7f-77ae62387e26 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.029159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a8f7a-6625-4779-8c7f-77ae62387e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.029605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a8f7a-6625-4779-8c7f-77ae62387e26 None admin] PATH_INFO: `/v3/services/network` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.030412 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a8f7a-6625-4779-8c7f-77ae62387e26 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.032404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a8f7a-6625-4779-8c7f-77ae62387e26 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.038725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 312/622] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:08:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:51.039573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e54689-532f-4f9d-9526-fab235e51500 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-ab0a8f7a-6625-4779-8c7f-77ae62387e26 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:51.043038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:51.044087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:51.044951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 311/623] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:50 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:51.046094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad96d91-ab44-487c-a67a-71bab4dc37bb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.046304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad96d91-ab44-487c-a67a-71bab4dc37bb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.046583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad96d91-ab44-487c-a67a-71bab4dc37bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.072523 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-dad96d91-ab44-487c-a67a-71bab4dc37bb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:51.074017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dad96d91-ab44-487c-a67a-71bab4dc37bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:51.150631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:51.170432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e54689-532f-4f9d-9526-fab235e51500 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:51.175422 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 312/624] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:08:51.176515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad96d91-ab44-487c-a67a-71bab4dc37bb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:51.218258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed2bc-809d-4108-a7ca-073e618f9b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.218872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed2bc-809d-4108-a7ca-073e618f9b11 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.219148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed2bc-809d-4108-a7ca-073e618f9b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.219592 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed2bc-809d-4108-a7ca-073e618f9b11 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.221962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ed2bc-809d-4108-a7ca-073e618f9b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:51.221962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ed2bc-809d-4108-a7ca-073e618f9b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.221962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ed2bc-809d-4108-a7ca-073e618f9b11 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.223451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:51.239394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 313/625] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:51.239394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed2bc-809d-4108-a7ca-073e618f9b11 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:51.318359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad96d91-ab44-487c-a67a-71bab4dc37bb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:51.367085 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed2bc-809d-4108-a7ca-073e618f9b11 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:51.371179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c638ef2-2989-4e2b-b0af-702df8503a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.371766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c638ef2-2989-4e2b-b0af-702df8503a6d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.372046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c638ef2-2989-4e2b-b0af-702df8503a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.372320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c638ef2-2989-4e2b-b0af-702df8503a6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.388240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c638ef2-2989-4e2b-b0af-702df8503a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.390575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c638ef2-2989-4e2b-b0af-702df8503a6d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.407107 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352639-ccf7-4b5e-863e-8a61746c3980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.407691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352639-ccf7-4b5e-863e-8a61746c3980 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.407970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352639-ccf7-4b5e-863e-8a61746c3980 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.408244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352639-ccf7-4b5e-863e-8a61746c3980 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.409423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a352639-ccf7-4b5e-863e-8a61746c3980 None admin] RBAC: Adding query filter params (name=network) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:51.409716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a352639-ccf7-4b5e-863e-8a61746c3980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.411070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a352639-ccf7-4b5e-863e-8a61746c3980 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-0c638ef2-2989-4e2b-b0af-702df8503a6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:51.413165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:51.414094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:51.415030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:51.415030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:51.415030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:51.416708 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 313/626] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:51.417309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c638ef2-2989-4e2b-b0af-702df8503a6d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:51.420020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 314/627] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:08:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:51.425371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352639-ccf7-4b5e-863e-8a61746c3980 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:51.442119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:51.520602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:51.532250 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352639-ccf7-4b5e-863e-8a61746c3980 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:51.535797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c638ef2-2989-4e2b-b0af-702df8503a6d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:51.572783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbcfb8-a92d-4e38-ae7b-4b9a28b4301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.574874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbcfb8-a92d-4e38-ae7b-4b9a28b4301c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.574874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbcfb8-a92d-4e38-ae7b-4b9a28b4301c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.574874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbcfb8-a92d-4e38-ae7b-4b9a28b4301c None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.574874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbcfb8-a92d-4e38-ae7b-4b9a28b4301c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:51.575207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbcfb8-a92d-4e38-ae7b-4b9a28b4301c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.576743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbcfb8-a92d-4e38-ae7b-4b9a28b4301c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.577585 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179433f-245b-4f26-9570-ca07068b22cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.578505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179433f-245b-4f26-9570-ca07068b22cb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.578786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179433f-245b-4f26-9570-ca07068b22cb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.579057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179433f-245b-4f26-9570-ca07068b22cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.588606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179433f-245b-4f26-9570-ca07068b22cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.590037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179433f-245b-4f26-9570-ca07068b22cb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.596536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 315/628] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:51.596536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbcfb8-a92d-4e38-ae7b-4b9a28b4301c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-4179433f-245b-4f26-9570-ca07068b22cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:51.601777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:51.602679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:51.603700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:51.603700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:51.603700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:51.603700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:51.603700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:51.603700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:51.603700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:51.603700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:51.603700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 314/629] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:51.604215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179433f-245b-4f26-9570-ca07068b22cb None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:51.678624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:51.707007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbcfb8-a92d-4e38-ae7b-4b9a28b4301c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:51.709853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179433f-245b-4f26-9570-ca07068b22cb None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:51.741495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c215d-5e0c-4d45-87ca-141203ed5dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.742200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c215d-5e0c-4d45-87ca-141203ed5dac None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.742544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c215d-5e0c-4d45-87ca-141203ed5dac None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.742716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c215d-5e0c-4d45-87ca-141203ed5dac None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.743370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c215d-5e0c-4d45-87ca-141203ed5dac None admin] RBAC: Adding query filter params (type=network) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:51.743680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c215d-5e0c-4d45-87ca-141203ed5dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.745047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c215d-5e0c-4d45-87ca-141203ed5dac None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.747387 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9cd0e-2fb1-4bf9-8c29-159044dfd00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.747996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9cd0e-2fb1-4bf9-8c29-159044dfd00e None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.748283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9cd0e-2fb1-4bf9-8c29-159044dfd00e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.748559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9cd0e-2fb1-4bf9-8c29-159044dfd00e None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.749208 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9cd0e-2fb1-4bf9-8c29-159044dfd00e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.755011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 316/630] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:08:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:51.755157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9cd0e-2fb1-4bf9-8c29-159044dfd00e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.755263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c215d-5e0c-4d45-87ca-141203ed5dac None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:51.771317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 315/631] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:08:51 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:51.771317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9cd0e-2fb1-4bf9-8c29-159044dfd00e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:51.795719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:51.875491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c215d-5e0c-4d45-87ca-141203ed5dac None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:51.921470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a44a6-089b-479c-8a0d-bc2c94f837b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.922123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a44a6-089b-479c-8a0d-bc2c94f837b6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.922407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a44a6-089b-479c-8a0d-bc2c94f837b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.922683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a44a6-089b-479c-8a0d-bc2c94f837b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.926338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:51.927291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9cd0e-2fb1-4bf9-8c29-159044dfd00e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:51.936664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a44a6-089b-479c-8a0d-bc2c94f837b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.938494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a44a6-089b-479c-8a0d-bc2c94f837b6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-025a44a6-089b-479c-8a0d-bc2c94f837b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:51.957209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:51.958164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:51.959056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:51.959056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:51.959056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:51.959056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:51.959056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:51.959056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:51.959056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:51.959056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:51.966426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 317/632] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:51.967472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a44a6-089b-479c-8a0d-bc2c94f837b6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:51.974460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31696-b9bb-4475-aff5-0070024da5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:51.975526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31696-b9bb-4475-aff5-0070024da5cc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:51.976024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31696-b9bb-4475-aff5-0070024da5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:51.976526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31696-b9bb-4475-aff5-0070024da5cc None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:51.977355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb31696-b9bb-4475-aff5-0070024da5cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:51.977766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb31696-b9bb-4475-aff5-0070024da5cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:51.979391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb31696-b9bb-4475-aff5-0070024da5cc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:51.994112 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 316/633] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:51.994944 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31696-b9bb-4475-aff5-0070024da5cc None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:52.077950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:52.101453 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a44a6-089b-479c-8a0d-bc2c94f837b6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:52.117398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31696-b9bb-4475-aff5-0070024da5cc None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:52.145704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0dd97-d2d8-4ce0-8d7e-5f7cdf0a92f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:52.146384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0dd97-d2d8-4ce0-8d7e-5f7cdf0a92f4 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:52.146701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0dd97-d2d8-4ce0-8d7e-5f7cdf0a92f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:52.147009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0dd97-d2d8-4ce0-8d7e-5f7cdf0a92f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:52.147761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0dd97-d2d8-4ce0-8d7e-5f7cdf0a92f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:52.150083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0dd97-d2d8-4ce0-8d7e-5f7cdf0a92f4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:52.156937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a92dd-485c-4c36-b39a-0cb9fbdeef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:52.157765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a92dd-485c-4c36-b39a-0cb9fbdeef44 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:52.158144 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a92dd-485c-4c36-b39a-0cb9fbdeef44 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:52.158554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a92dd-485c-4c36-b39a-0cb9fbdeef44 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:52.159518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a92dd-485c-4c36-b39a-0cb9fbdeef44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:52.160007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a92dd-485c-4c36-b39a-0cb9fbdeef44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:52.161527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a92dd-485c-4c36-b39a-0cb9fbdeef44 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:52.173575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 318/634] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:08:51 2022] POST /identity/v3/endpoints => generated 337 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:52.174785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 317/635] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:52.176222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0dd97-d2d8-4ce0-8d7e-5f7cdf0a92f4 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:52.188553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a92dd-485c-4c36-b39a-0cb9fbdeef44 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:52.267659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:52.323623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0dd97-d2d8-4ce0-8d7e-5f7cdf0a92f4 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:52.365970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e123d-be5b-490b-b574-63e4867694b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:52.366585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e123d-be5b-490b-b574-63e4867694b0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:52.366971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e123d-be5b-490b-b574-63e4867694b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:52.367254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e123d-be5b-490b-b574-63e4867694b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:52.368016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e123d-be5b-490b-b574-63e4867694b0 None admin] RBAC: Adding query filter params (role.id=58b61e8083c64fd58b3eb63efc4c7e3e, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=e2dc36f09ae941ecbf30ff11475e7f74) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:52.368424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e123d-be5b-490b-b574-63e4867694b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:52.369922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e123d-be5b-490b-b574-63e4867694b0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:52.377894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 319/636] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:08:52 2022] GET /identity/v3/role_assignments?user.id=e2dc36f09ae941ecbf30ff11475e7f74&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=58b61e8083c64fd58b3eb63efc4c7e3e => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:52.402730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a92dd-485c-4c36-b39a-0cb9fbdeef44 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:52.457859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:52.473241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574cd8a-1c9e-43f2-9908-b328f28e5a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:52.473878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574cd8a-1c9e-43f2-9908-b328f28e5a59 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:52.474167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574cd8a-1c9e-43f2-9908-b328f28e5a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:52.474444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574cd8a-1c9e-43f2-9908-b328f28e5a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:52.475191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574cd8a-1c9e-43f2-9908-b328f28e5a59 None admin] RBAC: Adding query filter params (role.id=9551be8340204b80958e4788f306cff6, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=0f67502c08b84cee80f57eb194fb731b) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:52.475527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574cd8a-1c9e-43f2-9908-b328f28e5a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:52.477047 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574cd8a-1c9e-43f2-9908-b328f28e5a59 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:52.486240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 318/637] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:08:52 2022] GET /identity/v3/role_assignments?user.id=0f67502c08b84cee80f57eb194fb731b&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=9551be8340204b80958e4788f306cff6 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:53.333527 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bb86c-f187-4f0a-b3b8-f99eac58f595 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:53.334204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bb86c-f187-4f0a-b3b8-f99eac58f595 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:53.334204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bb86c-f187-4f0a-b3b8-f99eac58f595 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:53.335759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 320/638] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:53.341509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecfdf6-f347-4907-b525-7d62f8dcf0d3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:53.342122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecfdf6-f347-4907-b525-7d62f8dcf0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:53.342122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecfdf6-f347-4907-b525-7d62f8dcf0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:53.361051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-54ecfdf6-f347-4907-b525-7d62f8dcf0d3 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:53.362945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-54ecfdf6-f347-4907-b525-7d62f8dcf0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:53.437852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 319/639] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:53 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:08:53.703288 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bb86c-f187-4f0a-b3b8-f99eac58f595 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:53.809822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bb86c-f187-4f0a-b3b8-f99eac58f595 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:53.820693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:53.844611 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c398e-aeab-4c49-aab0-12973fd402c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:53.845239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c398e-aeab-4c49-aab0-12973fd402c6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:53.845514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c398e-aeab-4c49-aab0-12973fd402c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:53.846301 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c398e-aeab-4c49-aab0-12973fd402c6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:53.846895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c398e-aeab-4c49-aab0-12973fd402c6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:53.848273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c398e-aeab-4c49-aab0-12973fd402c6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-c30c398e-aeab-4c49-aab0-12973fd402c6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:53.857049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:53.859340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:53.861359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 321/640] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:08:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:53.864350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecfdf6-f347-4907-b525-7d62f8dcf0d3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:53.973105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecfdf6-f347-4907-b525-7d62f8dcf0d3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:54.000636 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:54.015739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016934b7-585c-4294-858f-4bb7aa078d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:54.016743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016934b7-585c-4294-858f-4bb7aa078d3b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:54.017219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016934b7-585c-4294-858f-4bb7aa078d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:54.017731 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016934b7-585c-4294-858f-4bb7aa078d3b None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:54.018687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016934b7-585c-4294-858f-4bb7aa078d3b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:54.019293 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016934b7-585c-4294-858f-4bb7aa078d3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:54.020917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016934b7-585c-4294-858f-4bb7aa078d3b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:54.026351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 320/641] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:08:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:54.032274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c398e-aeab-4c49-aab0-12973fd402c6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:54.102359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69554e59-fc2f-482a-b161-50f3cf7c3626 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:54.102671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69554e59-fc2f-482a-b161-50f3cf7c3626 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:54.102910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69554e59-fc2f-482a-b161-50f3cf7c3626 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:54.104560 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 321/642] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:08:54.110087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e06321-a633-4044-8239-3e3530c05912 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:54.110372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e06321-a633-4044-8239-3e3530c05912 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:54.110721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e06321-a633-4044-8239-3e3530c05912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:54.135634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f3e06321-a633-4044-8239-3e3530c05912 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:54.137078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f3e06321-a633-4044-8239-3e3530c05912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:54.147316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c398e-aeab-4c49-aab0-12973fd402c6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:54.187244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94425e7a-7836-4b51-80b6-1885035fcb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:54.188223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94425e7a-7836-4b51-80b6-1885035fcb92 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:54.188704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94425e7a-7836-4b51-80b6-1885035fcb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:54.189194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94425e7a-7836-4b51-80b6-1885035fcb92 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:54.190960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94425e7a-7836-4b51-80b6-1885035fcb92 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:54.191517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94425e7a-7836-4b51-80b6-1885035fcb92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:54.193502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94425e7a-7836-4b51-80b6-1885035fcb92 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:54.199682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 322/643] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:08:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:54.224970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 322/644] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:54 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:08:54.492654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94425e7a-7836-4b51-80b6-1885035fcb92 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:54.539020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:54.605447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94425e7a-7836-4b51-80b6-1885035fcb92 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:54.640439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071124ae-64f1-449c-a86d-990b29b82161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:54.641108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071124ae-64f1-449c-a86d-990b29b82161 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:54.641391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071124ae-64f1-449c-a86d-990b29b82161 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:54.641662 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071124ae-64f1-449c-a86d-990b29b82161 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:54.642246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071124ae-64f1-449c-a86d-990b29b82161 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:54.644173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071124ae-64f1-449c-a86d-990b29b82161 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:54.648218 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa0033-7c61-418c-b2d1-a1ca092b1c96 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:54.648692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa0033-7c61-418c-b2d1-a1ca092b1c96 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:54.648772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa0033-7c61-418c-b2d1-a1ca092b1c96 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:54.650391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 323/645] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-071124ae-64f1-449c-a86d-990b29b82161 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:54.653108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:54.654026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:54.654970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 323/646] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Oct 21 21:08:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:54.661169 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa0033-7c61-418c-b2d1-a1ca092b1c96 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:54.661825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c7f9-a209-4c44-afb7-bbcb01423377 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:54.662110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c7f9-a209-4c44-afb7-bbcb01423377 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:54.662407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c7f9-a209-4c44-afb7-bbcb01423377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:54.685042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b391c7f9-a209-4c44-afb7-bbcb01423377 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:54.686549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b391c7f9-a209-4c44-afb7-bbcb01423377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:54.771425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 324/647] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:54 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:08:54.791692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7692-edcb-47d2-a98f-6c85dda93843 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:54.791987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7692-edcb-47d2-a98f-6c85dda93843 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:54.792492 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7692-edcb-47d2-a98f-6c85dda93843 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:54.793842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 325/648] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:08:54.798763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cf8d6-8fce-4f94-913e-ecc38b9ca830 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:54.799605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cf8d6-8fce-4f94-913e-ecc38b9ca830 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:54.799887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cf8d6-8fce-4f94-913e-ecc38b9ca830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:54.800514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa0033-7c61-418c-b2d1-a1ca092b1c96 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:54.818890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:54.825184 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-558cf8d6-8fce-4f94-913e-ecc38b9ca830 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:54.826332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-558cf8d6-8fce-4f94-913e-ecc38b9ca830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:54.838855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e6060-d953-483a-9265-dd3bbf65bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:54.839737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e6060-d953-483a-9265-dd3bbf65bdda None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:54.840209 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e6060-d953-483a-9265-dd3bbf65bdda None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:54.840650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e6060-d953-483a-9265-dd3bbf65bdda None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:54.841447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e6060-d953-483a-9265-dd3bbf65bdda None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:54.841930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e6060-d953-483a-9265-dd3bbf65bdda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:54.843537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e6060-d953-483a-9265-dd3bbf65bdda None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:54.849425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 324/649] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:08:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:54.859321 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e6060-d953-483a-9265-dd3bbf65bdda None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:54.860683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:54.910582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 326/650] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:54 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:08:54.977491 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e6060-d953-483a-9265-dd3bbf65bdda None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:55.013982 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaefe61-9a0f-4517-ab7e-f993211cbbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:55.014937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaefe61-9a0f-4517-ab7e-f993211cbbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:55.015393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaefe61-9a0f-4517-ab7e-f993211cbbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:55.015841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaefe61-9a0f-4517-ab7e-f993211cbbc0 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:55.016629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaefe61-9a0f-4517-ab7e-f993211cbbc0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:55.017079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaefe61-9a0f-4517-ab7e-f993211cbbc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:55.019115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaefe61-9a0f-4517-ab7e-f993211cbbc0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:55.029389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 325/651] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:08:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:08:55.030921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cf8d6-8fce-4f94-913e-ecc38b9ca830 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:55.042777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaefe61-9a0f-4517-ab7e-f993211cbbc0 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:55.104232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:55.164411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaefe61-9a0f-4517-ab7e-f993211cbbc0 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:55.172254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cf8d6-8fce-4f94-913e-ecc38b9ca830 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:55.207648 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431b472-0be8-41b9-82ff-4808c8fa8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:55.208287 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b472-0be8-41b9-82ff-4808c8fa8c9f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:55.208572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b472-0be8-41b9-82ff-4808c8fa8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:55.208851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b472-0be8-41b9-82ff-4808c8fa8c9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:55.209117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1948cb-9470-46a7-921b-ff5e05b372da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:55.209557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431b472-0be8-41b9-82ff-4808c8fa8c9f None admin] RBAC: Adding query filter params (interface=public, service_id=d73b63429a6645e48a7183b468965a15, region_id=RegionOne) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:55.209739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1948cb-9470-46a7-921b-ff5e05b372da None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:55.209898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431b472-0be8-41b9-82ff-4808c8fa8c9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:55.210051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1948cb-9470-46a7-921b-ff5e05b372da None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:55.210277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1948cb-9470-46a7-921b-ff5e05b372da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:55.210845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1948cb-9470-46a7-921b-ff5e05b372da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:55.211232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431b472-0be8-41b9-82ff-4808c8fa8c9f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:55.212211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1948cb-9470-46a7-921b-ff5e05b372da None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:55.223356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 327/652] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 21 21:08:55 2022] GET /identity/v3/endpoints?service_id=d73b63429a6645e48a7183b468965a15&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:55.223356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431b472-0be8-41b9-82ff-4808c8fa8c9f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-ed1948cb-9470-46a7-921b-ff5e05b372da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:55.223601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:55.224898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:55.225809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 326/653] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:08:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:55.231489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1948cb-9470-46a7-921b-ff5e05b372da None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:55.255429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:55.333786 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431b472-0be8-41b9-82ff-4808c8fa8c9f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:55.338924 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1948cb-9470-46a7-921b-ff5e05b372da None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:55.348066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:55.373151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24ae92-91ca-4c3d-afe3-d6a801d9f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:55.373824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24ae92-91ca-4c3d-afe3-d6a801d9f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:55.374058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24ae92-91ca-4c3d-afe3-d6a801d9f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:55.374420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24ae92-91ca-4c3d-afe3-d6a801d9f2a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:55.374957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f591-516e-4918-a646-e1742abf817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:55.375585 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f591-516e-4918-a646-e1742abf817c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:55.375863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f591-516e-4918-a646-e1742abf817c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:55.376129 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f591-516e-4918-a646-e1742abf817c None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:55.376747 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f591-516e-4918-a646-e1742abf817c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:55.377083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f591-516e-4918-a646-e1742abf817c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:55.378431 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f591-516e-4918-a646-e1742abf817c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:55.389187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 327/654] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:08:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:55.389187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f591-516e-4918-a646-e1742abf817c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:55.389425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24ae92-91ca-4c3d-afe3-d6a801d9f2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-5b24ae92-91ca-4c3d-afe3-d6a801d9f2a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:08:55.390917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:55.391948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:55.392804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 328/655] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 21 21:08:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:55.393511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24ae92-91ca-4c3d-afe3-d6a801d9f2a8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:55.483183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:55.499246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f591-516e-4918-a646-e1742abf817c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:55.502289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24ae92-91ca-4c3d-afe3-d6a801d9f2a8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:55.533001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fdd5a-b810-44bf-ba0b-707267370874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:55.534156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fdd5a-b810-44bf-ba0b-707267370874 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:55.534437 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fdd5a-b810-44bf-ba0b-707267370874 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:55.534712 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fdd5a-b810-44bf-ba0b-707267370874 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:55.535454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fdd5a-b810-44bf-ba0b-707267370874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:55.536699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fdd5a-b810-44bf-ba0b-707267370874 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:55.541989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 328/656] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 21 21:08:55 2022] GET /identity/v3/services => generated 1029 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:08:55.542765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fdd5a-b810-44bf-ba0b-707267370874 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:55.554714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69d74d-93cf-48ba-9089-9e2185c3237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:55.555650 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d74d-93cf-48ba-9089-9e2185c3237a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:55.556510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d74d-93cf-48ba-9089-9e2185c3237a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:55.557096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d74d-93cf-48ba-9089-9e2185c3237a None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:55.558027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69d74d-93cf-48ba-9089-9e2185c3237a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:55.558487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69d74d-93cf-48ba-9089-9e2185c3237a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:55.561055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69d74d-93cf-48ba-9089-9e2185c3237a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:55.570404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 329/657] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:08:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:55.587721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:55.670838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fdd5a-b810-44bf-ba0b-707267370874 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:55.713546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c192c5-30aa-4ad6-9891-731e02f265c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:55.714500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c192c5-30aa-4ad6-9891-731e02f265c2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:55.714933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c192c5-30aa-4ad6-9891-731e02f265c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:55.715402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c192c5-30aa-4ad6-9891-731e02f265c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:55.716256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c192c5-30aa-4ad6-9891-731e02f265c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:55.716711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c192c5-30aa-4ad6-9891-731e02f265c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:55.718281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c192c5-30aa-4ad6-9891-731e02f265c2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:55.729137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 329/658] 10.222.0.23 () {56 vars in 1115 bytes} [Fri Oct 21 21:08:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:55.735209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69d74d-93cf-48ba-9089-9e2185c3237a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:55.841138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69d74d-93cf-48ba-9089-9e2185c3237a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:55.875778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d9221-114a-4503-bbdf-2deb845dc00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:55.876642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d9221-114a-4503-bbdf-2deb845dc00f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:55.877089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d9221-114a-4503-bbdf-2deb845dc00f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:55.877527 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d9221-114a-4503-bbdf-2deb845dc00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:55.888338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d9221-114a-4503-bbdf-2deb845dc00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:55.890028 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d9221-114a-4503-bbdf-2deb845dc00f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-581d9221-114a-4503-bbdf-2deb845dc00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:55.904455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:55.905602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:55.906676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:55.906676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:55.906676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:55.908902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 330/659] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:55.914748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c192c5-30aa-4ad6-9891-731e02f265c2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:56.019431 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:56.024034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c192c5-30aa-4ad6-9891-731e02f265c2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:56.071675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0292db5-d6be-4a9b-90f6-b445bc4e8e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:56.072501 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0292db5-d6be-4a9b-90f6-b445bc4e8e35 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:56.072919 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0292db5-d6be-4a9b-90f6-b445bc4e8e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:56.073358 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0292db5-d6be-4a9b-90f6-b445bc4e8e35 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:56.074467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0292db5-d6be-4a9b-90f6-b445bc4e8e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:56.074904 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0292db5-d6be-4a9b-90f6-b445bc4e8e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:56.076426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0292db5-d6be-4a9b-90f6-b445bc4e8e35 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:56.089181 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 330/660] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:56.095155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d9221-114a-4503-bbdf-2deb845dc00f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:56.105280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:56.200419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d9221-114a-4503-bbdf-2deb845dc00f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:56.234064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7a1ab-8f82-4cbe-b025-57f4cb652432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:56.234695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7a1ab-8f82-4cbe-b025-57f4cb652432 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:56.234967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7a1ab-8f82-4cbe-b025-57f4cb652432 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:56.235234 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7a1ab-8f82-4cbe-b025-57f4cb652432 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:56.244192 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7a1ab-8f82-4cbe-b025-57f4cb652432 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:56.245739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7a1ab-8f82-4cbe-b025-57f4cb652432 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-2da7a1ab-8f82-4cbe-b025-57f4cb652432 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:08:56.258596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:56.259691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:56.260869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 331/661] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 21 21:08:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:56.266247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0292db5-d6be-4a9b-90f6-b445bc4e8e35 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:56.370303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ea861-d423-4f91-8152-1c08f1f01f7b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:56.370606 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ea861-d423-4f91-8152-1c08f1f01f7b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:56.370770 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ea861-d423-4f91-8152-1c08f1f01f7b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:56.372659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 332/662] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:08:56.374159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0292db5-d6be-4a9b-90f6-b445bc4e8e35 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:56.381286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f88694-7b64-46f3-b8f6-75e4952504b7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:56.381286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f88694-7b64-46f3-b8f6-75e4952504b7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:56.381286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f88694-7b64-46f3-b8f6-75e4952504b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:56.401113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-48f88694-7b64-46f3-b8f6-75e4952504b7 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:56.402336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-48f88694-7b64-46f3-b8f6-75e4952504b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:56.415910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90e314-1be4-436c-ab19-afdeaf43b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:56.416874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90e314-1be4-436c-ab19-afdeaf43b7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:56.417382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90e314-1be4-436c-ab19-afdeaf43b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:56.417845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90e314-1be4-436c-ab19-afdeaf43b7c1 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:56.418896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90e314-1be4-436c-ab19-afdeaf43b7c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:56.419444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90e314-1be4-436c-ab19-afdeaf43b7c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:56.421156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90e314-1be4-436c-ab19-afdeaf43b7c1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:56.441392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 331/663] 10.222.0.23 () {56 vars in 1149 bytes} [Fri Oct 21 21:08:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:56.446599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90e314-1be4-436c-ab19-afdeaf43b7c1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:56.464672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:56.474018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:56.489395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 333/664] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:08:56.556840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90e314-1be4-436c-ab19-afdeaf43b7c1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:56.595481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116bd7f-0e9c-4c19-81b4-557a8a0b8270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:56.597022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116bd7f-0e9c-4c19-81b4-557a8a0b8270 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:56.597607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116bd7f-0e9c-4c19-81b4-557a8a0b8270 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:56.598074 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116bd7f-0e9c-4c19-81b4-557a8a0b8270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:56.608916 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116bd7f-0e9c-4c19-81b4-557a8a0b8270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:56.610547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116bd7f-0e9c-4c19-81b4-557a8a0b8270 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-a116bd7f-0e9c-4c19-81b4-557a8a0b8270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:08:56.626183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:56.627890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:08:56.628883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:08:56.628883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:08:56.628883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:56.630724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 332/665] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:08:56.636092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f88694-7b64-46f3-b8f6-75e4952504b7 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:56.738334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f88694-7b64-46f3-b8f6-75e4952504b7 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:56.764527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116bd7f-0e9c-4c19-81b4-557a8a0b8270 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:56.774987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a68fd-1df8-41ab-9526-123e5b81866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:56.775573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a68fd-1df8-41ab-9526-123e5b81866a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:56.775857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a68fd-1df8-41ab-9526-123e5b81866a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:56.776134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a68fd-1df8-41ab-9526-123e5b81866a None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:56.776784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a68fd-1df8-41ab-9526-123e5b81866a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:56.777457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a68fd-1df8-41ab-9526-123e5b81866a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:56.778585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a68fd-1df8-41ab-9526-123e5b81866a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:56.791246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 334/666] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:56.796995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a68fd-1df8-41ab-9526-123e5b81866a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:56.854589 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:56.868562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:56.901452 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116bd7f-0e9c-4c19-81b4-557a8a0b8270 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:56.936635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a68fd-1df8-41ab-9526-123e5b81866a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:56.941826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292620a-bc54-4f63-9481-63673291a439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:56.942530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292620a-bc54-4f63-9481-63673291a439 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:56.942874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292620a-bc54-4f63-9481-63673291a439 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:56.943209 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292620a-bc54-4f63-9481-63673291a439 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:56.943948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292620a-bc54-4f63-9481-63673291a439 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:56.945362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292620a-bc54-4f63-9481-63673291a439 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:56.963852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 333/667] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:08:56 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:56.989179 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa487d51-ca87-48aa-9681-ecc8a1e85369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:56.989890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa487d51-ca87-48aa-9681-ecc8a1e85369 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:56.990178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa487d51-ca87-48aa-9681-ecc8a1e85369 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:56.990455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa487d51-ca87-48aa-9681-ecc8a1e85369 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:56.998877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa487d51-ca87-48aa-9681-ecc8a1e85369 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:57.000394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa487d51-ca87-48aa-9681-ecc8a1e85369 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-aa487d51-ca87-48aa-9681-ecc8a1e85369 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:08:57.013809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:57.014747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:57.015668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:08:57.015668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:08:57.015668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:08:57.015668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:08:57.015668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:08:57.015668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:08:57.015668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:08:57.015668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:57.015668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 335/668] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:57.021329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292620a-bc54-4f63-9481-63673291a439 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:57.146268 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292620a-bc54-4f63-9481-63673291a439 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:57.173077 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:57.182702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe98cc-4792-496f-a726-52d4ee2fa8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:57.183850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe98cc-4792-496f-a726-52d4ee2fa8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:57.184127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe98cc-4792-496f-a726-52d4ee2fa8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:57.184397 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe98cc-4792-496f-a726-52d4ee2fa8c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:57.185092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe98cc-4792-496f-a726-52d4ee2fa8c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:57.185390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe98cc-4792-496f-a726-52d4ee2fa8c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:57.186830 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe98cc-4792-496f-a726-52d4ee2fa8c3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:57.201202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 334/669] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:57.211300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa487d51-ca87-48aa-9681-ecc8a1e85369 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:57.309066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa487d51-ca87-48aa-9681-ecc8a1e85369 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:57.318260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:57.344634 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f9094-f37f-4e6a-923a-9edf84a7e502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:57.345288 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f9094-f37f-4e6a-923a-9edf84a7e502 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:57.345565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f9094-f37f-4e6a-923a-9edf84a7e502 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:57.346412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f9094-f37f-4e6a-923a-9edf84a7e502 None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/0f67502c08b84cee80f57eb194fb731b/roles/aee2782258cd4ca6b1171d38e9c05add` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:57.348631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f9094-f37f-4e6a-923a-9edf84a7e502 None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=0f67502c08b84cee80f57eb194fb731b, role_id=aee2782258cd4ca6b1171d38e9c05add)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:57.350046 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f9094-f37f-4e6a-923a-9edf84a7e502 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:57.365066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 336/670] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:08:57 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/0f67502c08b84cee80f57eb194fb731b/roles/aee2782258cd4ca6b1171d38e9c05add => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:08:57.822767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357dcee-0d7f-4cb6-bb79-f9952b604db1 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:57.823322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357dcee-0d7f-4cb6-bb79-f9952b604db1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:57.823322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357dcee-0d7f-4cb6-bb79-f9952b604db1 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:57.825346 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 335/671] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:57.832100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43a06-6fd6-4549-9a77-b732bfd264b5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:57.832619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43a06-6fd6-4549-9a77-b732bfd264b5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:57.832695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43a06-6fd6-4549-9a77-b732bfd264b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:57.851927 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b9e43a06-6fd6-4549-9a77-b732bfd264b5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:57.853118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b9e43a06-6fd6-4549-9a77-b732bfd264b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:57.935384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 337/672] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:08:57.942147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07256-67dc-4239-9397-f8596eb15778 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:57.942437 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07256-67dc-4239-9397-f8596eb15778 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:57.942713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07256-67dc-4239-9397-f8596eb15778 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:57.944204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 336/673] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:57.949842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50078b5-3a11-42c7-8bcb-9a8a0de772b6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:57.950131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50078b5-3a11-42c7-8bcb-9a8a0de772b6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:57.950411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50078b5-3a11-42c7-8bcb-9a8a0de772b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:57.968978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f50078b5-3a11-42c7-8bcb-9a8a0de772b6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:57.970162 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f50078b5-3a11-42c7-8bcb-9a8a0de772b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:58.043224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 338/674] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:08:58.224133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07256-67dc-4239-9397-f8596eb15778 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:58.328548 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50078b5-3a11-42c7-8bcb-9a8a0de772b6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:58.332552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07256-67dc-4239-9397-f8596eb15778 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:58.358967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:58.373701 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7d622-92a5-43a3-884d-6155519a8bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:58.374613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7d622-92a5-43a3-884d-6155519a8bfc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:58.375093 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7d622-92a5-43a3-884d-6155519a8bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:58.375615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7d622-92a5-43a3-884d-6155519a8bfc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:58.376389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7d622-92a5-43a3-884d-6155519a8bfc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:58.378495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7d622-92a5-43a3-884d-6155519a8bfc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b8c7d622-92a5-43a3-884d-6155519a8bfc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:58.387646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:58.388588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 21 21:08:58.389554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:08:58.397347 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 337/675] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Oct 21 21:08:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:58.398381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7d622-92a5-43a3-884d-6155519a8bfc None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:58.447416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50078b5-3a11-42c7-8bcb-9a8a0de772b6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:58.453445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:58.489903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a26aa-a9d4-45a2-8166-d468df980bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:58.490435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a26aa-a9d4-45a2-8166-d468df980bd1 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:58.490713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a26aa-a9d4-45a2-8166-d468df980bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:58.490983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a26aa-a9d4-45a2-8166-d468df980bd1 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:58.491658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a26aa-a9d4-45a2-8166-d468df980bd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:58.493135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a26aa-a9d4-45a2-8166-d468df980bd1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:58.505913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7d622-92a5-43a3-884d-6155519a8bfc None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:58.515350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 339/676] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:08:58 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:58.552330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68f00f-3d8f-49bb-a697-6c05c1631e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:58.553357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68f00f-3d8f-49bb-a697-6c05c1631e85 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:58.553810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68f00f-3d8f-49bb-a697-6c05c1631e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:58.554253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68f00f-3d8f-49bb-a697-6c05c1631e85 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:58.555066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68f00f-3d8f-49bb-a697-6c05c1631e85 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:58.555575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68f00f-3d8f-49bb-a697-6c05c1631e85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:58.557221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68f00f-3d8f-49bb-a697-6c05c1631e85 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:58.563344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 338/677] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:08:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:58.572600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a26aa-a9d4-45a2-8166-d468df980bd1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:58.672958 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:58.687988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a26aa-a9d4-45a2-8166-d468df980bd1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:58.723790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf66fb-0c62-4584-a729-b0f221c305ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:58.724402 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf66fb-0c62-4584-a729-b0f221c305ac None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:58.724730 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf66fb-0c62-4584-a729-b0f221c305ac None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:58.725011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf66fb-0c62-4584-a729-b0f221c305ac None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:58.725640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf66fb-0c62-4584-a729-b0f221c305ac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:58.725939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf66fb-0c62-4584-a729-b0f221c305ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:58.727306 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf66fb-0c62-4584-a729-b0f221c305ac None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:58.732659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 340/678] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:08:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:58.741481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68f00f-3d8f-49bb-a697-6c05c1631e85 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:58.852642 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68f00f-3d8f-49bb-a697-6c05c1631e85 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:58.866791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:58.890725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b3aa1-41fe-47ac-82fb-6a8ae5220c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:58.891676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b3aa1-41fe-47ac-82fb-6a8ae5220c30 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:58.892156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b3aa1-41fe-47ac-82fb-6a8ae5220c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:58.892650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b3aa1-41fe-47ac-82fb-6a8ae5220c30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:58.893506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b3aa1-41fe-47ac-82fb-6a8ae5220c30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:58.895044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b3aa1-41fe-47ac-82fb-6a8ae5220c30 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:58.918843 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 339/679] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:08:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:08:59.200295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd341314-80ff-41d1-bef1-412ef970d4f0 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:59.200802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd341314-80ff-41d1-bef1-412ef970d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:59.200876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd341314-80ff-41d1-bef1-412ef970d4f0 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:59.202453 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 341/680] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:59.207836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d8bd4-6120-4f82-b6f5-332160bb3d4c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:59.208130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d8bd4-6120-4f82-b6f5-332160bb3d4c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:59.208411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d8bd4-6120-4f82-b6f5-332160bb3d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:59.227748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f94d8bd4-6120-4f82-b6f5-332160bb3d4c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:59.228957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f94d8bd4-6120-4f82-b6f5-332160bb3d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:59.311464 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 340/681] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:08:59.578372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd341314-80ff-41d1-bef1-412ef970d4f0 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:59.600882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c24d2-7a26-48d2-ae2a-8b1ce5b937ed None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:59.601194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c24d2-7a26-48d2-ae2a-8b1ce5b937ed None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:59.601433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c24d2-7a26-48d2-ae2a-8b1ce5b937ed None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:59.602780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 341/682] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:08:59.607731 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e12ff-f514-40ec-b927-949ede68cb44 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:59.608016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e12ff-f514-40ec-b927-949ede68cb44 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:59.608294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e12ff-f514-40ec-b927-949ede68cb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:59.629375 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3d9e12ff-f514-40ec-b927-949ede68cb44 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:08:59.630856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3d9e12ff-f514-40ec-b927-949ede68cb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:08:59.703199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd341314-80ff-41d1-bef1-412ef970d4f0 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:59.719356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 342/683] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:08:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:08:59.745544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341ef06-ef04-44c0-9882-4eb9cdbf2f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:59.746258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341ef06-ef04-44c0-9882-4eb9cdbf2f15 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:59.746605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341ef06-ef04-44c0-9882-4eb9cdbf2f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:59.746885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341ef06-ef04-44c0-9882-4eb9cdbf2f15 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:59.747590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341ef06-ef04-44c0-9882-4eb9cdbf2f15 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:59.749077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341ef06-ef04-44c0-9882-4eb9cdbf2f15 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-c341ef06-ef04-44c0-9882-4eb9cdbf2f15 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:08:59.758924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:08:59.759968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 21 21:08:59.760837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:08:59.765077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 342/684] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:08:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:08:59.766494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e12ff-f514-40ec-b927-949ede68cb44 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:59.796108 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:59.880771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e12ff-f514-40ec-b927-949ede68cb44 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:08:59.917950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36783df4-8223-4436-bec3-ceff67fde13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:08:59.918926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36783df4-8223-4436-bec3-ceff67fde13c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:08:59.919449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36783df4-8223-4436-bec3-ceff67fde13c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:08:59.919984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36783df4-8223-4436-bec3-ceff67fde13c None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:08:59.920861 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36783df4-8223-4436-bec3-ceff67fde13c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:08:59.921352 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36783df4-8223-4436-bec3-ceff67fde13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:08:59.922891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36783df4-8223-4436-bec3-ceff67fde13c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:08:59.928824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 343/685] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:08:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:08:59.934298 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341ef06-ef04-44c0-9882-4eb9cdbf2f15 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:08:59.954465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:08:59.989473 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36783df4-8223-4436-bec3-ceff67fde13c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:00.054887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341ef06-ef04-44c0-9882-4eb9cdbf2f15 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:00.095756 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55cc70-04e1-4fd2-a7f4-02c132d2fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:00.097211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55cc70-04e1-4fd2-a7f4-02c132d2fc30 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:00.097731 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55cc70-04e1-4fd2-a7f4-02c132d2fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:00.098206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55cc70-04e1-4fd2-a7f4-02c132d2fc30 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:00.099109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55cc70-04e1-4fd2-a7f4-02c132d2fc30 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:00.099632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55cc70-04e1-4fd2-a7f4-02c132d2fc30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:00.099755 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:00.101415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55cc70-04e1-4fd2-a7f4-02c132d2fc30 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:00.112409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 343/686] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:08:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:00.114038 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55cc70-04e1-4fd2-a7f4-02c132d2fc30 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:00.117550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36783df4-8223-4436-bec3-ceff67fde13c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:00.161592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea383a-ba7e-44bd-92ce-59fd5ab6e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:00.162145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea383a-ba7e-44bd-92ce-59fd5ab6e9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:00.162420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea383a-ba7e-44bd-92ce-59fd5ab6e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:00.162691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea383a-ba7e-44bd-92ce-59fd5ab6e9f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:00.175661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea383a-ba7e-44bd-92ce-59fd5ab6e9f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-6aea383a-ba7e-44bd-92ce-59fd5ab6e9f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:09:00.182401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:00.183383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:00.188376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 344/687] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 21 21:08:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:00.192409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea383a-ba7e-44bd-92ce-59fd5ab6e9f3 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:00.212603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:00.233448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55cc70-04e1-4fd2-a7f4-02c132d2fc30 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:00.277870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2689e-2b54-464d-ab67-5cd433d80b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:00.278482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2689e-2b54-464d-ab67-5cd433d80b14 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:00.278755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2689e-2b54-464d-ab67-5cd433d80b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:00.279020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2689e-2b54-464d-ab67-5cd433d80b14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:00.279749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2689e-2b54-464d-ab67-5cd433d80b14 None admin] RBAC: Adding query filter params (interface=public, service_id=409e43fb461a40c1ae78979140a61db9, region_id=RegionOne) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:00.280051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2689e-2b54-464d-ab67-5cd433d80b14 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:00.281471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2689e-2b54-464d-ab67-5cd433d80b14 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:00.291638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 344/688] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 21 21:09:00 2022] GET /identity/v3/endpoints?service_id=409e43fb461a40c1ae78979140a61db9&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:00.293013 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2689e-2b54-464d-ab67-5cd433d80b14 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:00.323233 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea383a-ba7e-44bd-92ce-59fd5ab6e9f3 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:00.363035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e37d5-625a-4043-8a45-e7971f1052b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:00.364022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e37d5-625a-4043-8a45-e7971f1052b7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:00.364505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e37d5-625a-4043-8a45-e7971f1052b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:00.365080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e37d5-625a-4043-8a45-e7971f1052b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:00.366065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e37d5-625a-4043-8a45-e7971f1052b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:00.366578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e37d5-625a-4043-8a45-e7971f1052b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:00.368378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e37d5-625a-4043-8a45-e7971f1052b7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:00.383159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 345/689] 10.222.0.23 () {56 vars in 1115 bytes} [Fri Oct 21 21:09:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:00.384722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e37d5-625a-4043-8a45-e7971f1052b7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:00.396555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2689e-2b54-464d-ab67-5cd433d80b14 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:00.399456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:00.431784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a3576-8d05-4f51-acbc-6ca7a7e06c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:00.432395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3576-8d05-4f51-acbc-6ca7a7e06c88 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:00.432670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3576-8d05-4f51-acbc-6ca7a7e06c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:00.432939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3576-8d05-4f51-acbc-6ca7a7e06c88 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:00.433541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a3576-8d05-4f51-acbc-6ca7a7e06c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:00.434877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a3576-8d05-4f51-acbc-6ca7a7e06c88 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:00.447336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 345/690] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 21 21:09:00 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:09:00.510283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e37d5-625a-4043-8a45-e7971f1052b7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:00.547547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb0701-ada9-4e95-b56a-cdca8b4341b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:00.548197 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb0701-ada9-4e95-b56a-cdca8b4341b8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:00.548474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb0701-ada9-4e95-b56a-cdca8b4341b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:00.548771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb0701-ada9-4e95-b56a-cdca8b4341b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:00.561744 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb0701-ada9-4e95-b56a-cdca8b4341b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:00.563357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb0701-ada9-4e95-b56a-cdca8b4341b8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-0fbb0701-ada9-4e95-b56a-cdca8b4341b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:09:00.579430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:00.580570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:09:00.581675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:09:00.581675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:00.581675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:00.581675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 346/691] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:09:00.588408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a3576-8d05-4f51-acbc-6ca7a7e06c88 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:00.600991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:00.703296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a3576-8d05-4f51-acbc-6ca7a7e06c88 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:00.743116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30ce1c-f24b-4f33-b89c-b5b54748dadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:00.744216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ce1c-f24b-4f33-b89c-b5b54748dadf None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:00.744746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ce1c-f24b-4f33-b89c-b5b54748dadf None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:00.745402 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ce1c-f24b-4f33-b89c-b5b54748dadf None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:00.746174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30ce1c-f24b-4f33-b89c-b5b54748dadf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:00.746685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30ce1c-f24b-4f33-b89c-b5b54748dadf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:00.748356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30ce1c-f24b-4f33-b89c-b5b54748dadf None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:00.766447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 346/692] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:00.769540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb0701-ada9-4e95-b56a-cdca8b4341b8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:00.836490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:00.849861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099954d-5ddb-4112-908b-5a7e5fee76de None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:00.850183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099954d-5ddb-4112-908b-5a7e5fee76de None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:00.850414 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099954d-5ddb-4112-908b-5a7e5fee76de None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:00.852017 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 347/693] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:09:00.857011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8ac3f-f816-4392-b931-af8c863ab0f4 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:00.857295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8ac3f-f816-4392-b931-af8c863ab0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:00.857560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8ac3f-f816-4392-b931-af8c863ab0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:00.878476 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-58b8ac3f-f816-4392-b931-af8c863ab0f4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:00.879810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-58b8ac3f-f816-4392-b931-af8c863ab0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:00.888708 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb0701-ada9-4e95-b56a-cdca8b4341b8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:00.928037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320e47b-169c-4733-a91d-def8290baf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:00.929030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320e47b-169c-4733-a91d-def8290baf0d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:00.929515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320e47b-169c-4733-a91d-def8290baf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:00.929995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320e47b-169c-4733-a91d-def8290baf0d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:00.938301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320e47b-169c-4733-a91d-def8290baf0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:00.940695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320e47b-169c-4733-a91d-def8290baf0d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-c320e47b-169c-4733-a91d-def8290baf0d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:09:00.952990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:00.954033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:00.955080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:00.955080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:00.955080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:09:00.955080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:09:00.955080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:09:00.955080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:09:00.955080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:09:00.955080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:09:00.955080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 21 21:09:00.955080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:00.955737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:00.962712 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 347/694] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 21 21:09:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:00.964462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320e47b-169c-4733-a91d-def8290baf0d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:00.971357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 348/695] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:09:01.082765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320e47b-169c-4733-a91d-def8290baf0d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:01.110294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:01.120008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2f6c-84ef-48d0-9241-b1f9fc441574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:01.120887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2f6c-84ef-48d0-9241-b1f9fc441574 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:01.121387 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2f6c-84ef-48d0-9241-b1f9fc441574 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:01.121862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2f6c-84ef-48d0-9241-b1f9fc441574 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:01.122786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2f6c-84ef-48d0-9241-b1f9fc441574 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:01.123387 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2f6c-84ef-48d0-9241-b1f9fc441574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:01.125110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2f6c-84ef-48d0-9241-b1f9fc441574 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:01.149161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 348/696] 10.222.0.23 () {56 vars in 1149 bytes} [Fri Oct 21 21:09:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:01.151108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433c69c-88e1-41cd-85f3-a8eadbd52577 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:01.151880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433c69c-88e1-41cd-85f3-a8eadbd52577 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:01.152390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433c69c-88e1-41cd-85f3-a8eadbd52577 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:01.152497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2f6c-84ef-48d0-9241-b1f9fc441574 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:01.154620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 349/697] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:01.160577 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c062f81-9216-4152-80cc-25227e0a8b54 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:01.160863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c062f81-9216-4152-80cc-25227e0a8b54 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:01.161141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c062f81-9216-4152-80cc-25227e0a8b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:01.180202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8c062f81-9216-4152-80cc-25227e0a8b54 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:01.181511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8c062f81-9216-4152-80cc-25227e0a8b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:01.263643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 350/698] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:09:01.271292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c062f81-9216-4152-80cc-25227e0a8b54 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:01.275363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2f6c-84ef-48d0-9241-b1f9fc441574 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:01.324586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc29779-67f5-4e15-bec9-7bbae3537376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:01.326304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc29779-67f5-4e15-bec9-7bbae3537376 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:01.326794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc29779-67f5-4e15-bec9-7bbae3537376 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:01.327511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc29779-67f5-4e15-bec9-7bbae3537376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:01.387908 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c062f81-9216-4152-80cc-25227e0a8b54 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:01.393311 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:01.423871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc29779-67f5-4e15-bec9-7bbae3537376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:01.425126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:01.426807 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc29779-67f5-4e15-bec9-7bbae3537376 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:01.441542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7bf2e-5fe7-4fb9-ab57-caa9f0393693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:01.442482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7bf2e-5fe7-4fb9-ab57-caa9f0393693 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:01.442947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7bf2e-5fe7-4fb9-ab57-caa9f0393693 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:01.443424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7bf2e-5fe7-4fb9-ab57-caa9f0393693 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:01.444237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7bf2e-5fe7-4fb9-ab57-caa9f0393693 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:01.445788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7bf2e-5fe7-4fb9-ab57-caa9f0393693 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-07b7bf2e-5fe7-4fb9-ab57-caa9f0393693 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:01.457111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:01.458087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:01.458931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:01.461971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 351/699] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:09:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:09:01.467218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7bf2e-5fe7-4fb9-ab57-caa9f0393693 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:01.557669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 349/700] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:09:01 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 21 21:09:01.557669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc29779-67f5-4e15-bec9-7bbae3537376 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:01.581193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7bf2e-5fe7-4fb9-ab57-caa9f0393693 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:01.621497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56a19-557c-44b6-b529-767afeccc7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:01.622333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56a19-557c-44b6-b529-767afeccc7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:01.622614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56a19-557c-44b6-b529-767afeccc7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:01.622895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56a19-557c-44b6-b529-767afeccc7f1 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:01.623560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e56a19-557c-44b6-b529-767afeccc7f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:01.623865 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e56a19-557c-44b6-b529-767afeccc7f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:01.625219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e56a19-557c-44b6-b529-767afeccc7f1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:01.629884 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 352/701] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:09:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:01.630649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56a19-557c-44b6-b529-767afeccc7f1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:01.651857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:01.672730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc29779-67f5-4e15-bec9-7bbae3537376 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:01.691900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:01.711248 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741470e-3a19-4c6f-bd63-e1d7f9c33e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:01.711916 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741470e-3a19-4c6f-bd63-e1d7f9c33e89 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:01.712199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741470e-3a19-4c6f-bd63-e1d7f9c33e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:01.712555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741470e-3a19-4c6f-bd63-e1d7f9c33e89 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:01.713146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741470e-3a19-4c6f-bd63-e1d7f9c33e89 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:01.715326 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741470e-3a19-4c6f-bd63-e1d7f9c33e89 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-e741470e-3a19-4c6f-bd63-e1d7f9c33e89 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:01.726014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:01.727098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:01.728294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 350/702] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:09:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:01.729091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741470e-3a19-4c6f-bd63-e1d7f9c33e89 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:01.744979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56a19-557c-44b6-b529-767afeccc7f1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:01.782767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca223a-1812-47c1-8229-93ba8e5bb7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:01.783556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca223a-1812-47c1-8229-93ba8e5bb7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:01.783838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca223a-1812-47c1-8229-93ba8e5bb7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:01.784111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca223a-1812-47c1-8229-93ba8e5bb7a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:01.794727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca223a-1812-47c1-8229-93ba8e5bb7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:01.796196 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca223a-1812-47c1-8229-93ba8e5bb7a6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-3aca223a-1812-47c1-8229-93ba8e5bb7a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:09:01.810709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:01.811868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:09:01.812766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:09:01.812766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:01.812766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:01.812766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 353/703] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:01.813008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca223a-1812-47c1-8229-93ba8e5bb7a6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:01.850712 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741470e-3a19-4c6f-bd63-e1d7f9c33e89 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:01.890898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0bbb4-ca25-4d38-a699-6f34bc40d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:01.891586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0bbb4-ca25-4d38-a699-6f34bc40d924 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:01.891798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0bbb4-ca25-4d38-a699-6f34bc40d924 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:01.892070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0bbb4-ca25-4d38-a699-6f34bc40d924 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:01.893268 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0bbb4-ca25-4d38-a699-6f34bc40d924 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:01.893571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0bbb4-ca25-4d38-a699-6f34bc40d924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:01.894929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0bbb4-ca25-4d38-a699-6f34bc40d924 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:01.904625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 351/704] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:09:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:01.904625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0bbb4-ca25-4d38-a699-6f34bc40d924 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:01.915984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:01.928239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca223a-1812-47c1-8229-93ba8e5bb7a6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:01.937863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:01.966095 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5b13-b5e2-44d3-99d0-28d0203dffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:01.966840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5b13-b5e2-44d3-99d0-28d0203dffba None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:01.967123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5b13-b5e2-44d3-99d0-28d0203dffba None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:01.967485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5b13-b5e2-44d3-99d0-28d0203dffba None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:01.968186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e5b13-b5e2-44d3-99d0-28d0203dffba None admin] RBAC: Adding query filter params (name=compute) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:01.968551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e5b13-b5e2-44d3-99d0-28d0203dffba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:01.969965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e5b13-b5e2-44d3-99d0-28d0203dffba None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:01.979713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 354/705] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:09:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:01.979713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5b13-b5e2-44d3-99d0-28d0203dffba None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:02.016087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0bbb4-ca25-4d38-a699-6f34bc40d924 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:02.054518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186fa06-89f6-49ff-af87-09185f5235c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:02.055548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186fa06-89f6-49ff-af87-09185f5235c7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:02.055961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186fa06-89f6-49ff-af87-09185f5235c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:02.056337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186fa06-89f6-49ff-af87-09185f5235c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:02.057135 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186fa06-89f6-49ff-af87-09185f5235c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:02.057559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186fa06-89f6-49ff-af87-09185f5235c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:02.059205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186fa06-89f6-49ff-af87-09185f5235c7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:02.077042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 352/706] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:02.077993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186fa06-89f6-49ff-af87-09185f5235c7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:02.090248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5b13-b5e2-44d3-99d0-28d0203dffba None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:02.126504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9270578-d2e9-492a-bd97-342443d7240c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:02.127804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9270578-d2e9-492a-bd97-342443d7240c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:02.128082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9270578-d2e9-492a-bd97-342443d7240c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:02.128351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9270578-d2e9-492a-bd97-342443d7240c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:02.129044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9270578-d2e9-492a-bd97-342443d7240c None admin] RBAC: Adding query filter params (interface=public, service_id=711e3e4d07184e2297e69f2ddffe2eb1, region_id=RegionOne) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:02.129345 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9270578-d2e9-492a-bd97-342443d7240c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:02.130687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9270578-d2e9-492a-bd97-342443d7240c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:02.136626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 355/707] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 21 21:09:01 2022] GET /identity/v3/endpoints?service_id=711e3e4d07184e2297e69f2ddffe2eb1&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:02.141937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9270578-d2e9-492a-bd97-342443d7240c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:02.148632 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:02.179260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:02.185168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186fa06-89f6-49ff-af87-09185f5235c7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:02.221595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc005038-960c-4711-9f60-6a71c5f0ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:02.222204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc005038-960c-4711-9f60-6a71c5f0ee76 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:02.222471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc005038-960c-4711-9f60-6a71c5f0ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:02.222745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc005038-960c-4711-9f60-6a71c5f0ee76 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:02.223394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc005038-960c-4711-9f60-6a71c5f0ee76 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:02.223698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc005038-960c-4711-9f60-6a71c5f0ee76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:02.225068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc005038-960c-4711-9f60-6a71c5f0ee76 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:02.235475 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 353/708] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:09:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:02.237424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc005038-960c-4711-9f60-6a71c5f0ee76 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:02.254195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9270578-d2e9-492a-bd97-342443d7240c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:02.292775 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316febf-7b91-4d1c-881c-95caf7b8b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:02.293460 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316febf-7b91-4d1c-881c-95caf7b8b31c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:02.293707 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316febf-7b91-4d1c-881c-95caf7b8b31c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:02.293986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316febf-7b91-4d1c-881c-95caf7b8b31c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:02.302360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316febf-7b91-4d1c-881c-95caf7b8b31c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:02.303897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316febf-7b91-4d1c-881c-95caf7b8b31c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-a316febf-7b91-4d1c-881c-95caf7b8b31c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:09:02.317089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:02.318108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:02.319018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:09:02.319018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:09:02.319018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:09:02.319018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:09:02.319018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:09:02.319018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:09:02.319018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:09:02.319018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:02.323322 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 356/709] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:02.324560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316febf-7b91-4d1c-881c-95caf7b8b31c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:02.366025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc005038-960c-4711-9f60-6a71c5f0ee76 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:02.400989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:02.407862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437a90c-e7ea-4abc-88b5-a0f0dfe4c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:02.409313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437a90c-e7ea-4abc-88b5-a0f0dfe4c9db None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:02.409658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437a90c-e7ea-4abc-88b5-a0f0dfe4c9db None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:02.409995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437a90c-e7ea-4abc-88b5-a0f0dfe4c9db None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:02.410700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437a90c-e7ea-4abc-88b5-a0f0dfe4c9db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:02.412158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437a90c-e7ea-4abc-88b5-a0f0dfe4c9db None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:02.418995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 354/710] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 21 21:09:02 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:09:02.432862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:02.440093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316febf-7b91-4d1c-881c-95caf7b8b31c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:02.480223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165af47e-b645-4bd9-93eb-fd60b6f6195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:02.480855 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165af47e-b645-4bd9-93eb-fd60b6f6195b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:02.481134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165af47e-b645-4bd9-93eb-fd60b6f6195b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:02.481407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165af47e-b645-4bd9-93eb-fd60b6f6195b None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:02.482127 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165af47e-b645-4bd9-93eb-fd60b6f6195b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:02.482429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165af47e-b645-4bd9-93eb-fd60b6f6195b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:02.483929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165af47e-b645-4bd9-93eb-fd60b6f6195b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:02.498322 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 357/711] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:02.504370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437a90c-e7ea-4abc-88b5-a0f0dfe4c9db None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:02.622799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437a90c-e7ea-4abc-88b5-a0f0dfe4c9db None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:02.660206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275d77a-a7f3-4de1-8c5b-29368b8ddf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:02.660970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275d77a-a7f3-4de1-8c5b-29368b8ddf94 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:02.661360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275d77a-a7f3-4de1-8c5b-29368b8ddf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:02.661740 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275d77a-a7f3-4de1-8c5b-29368b8ddf94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:02.662581 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275d77a-a7f3-4de1-8c5b-29368b8ddf94 None admin] RBAC: Adding query filter params (role.id=aee2782258cd4ca6b1171d38e9c05add, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=0f67502c08b84cee80f57eb194fb731b) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:02.662995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275d77a-a7f3-4de1-8c5b-29368b8ddf94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:02.664553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275d77a-a7f3-4de1-8c5b-29368b8ddf94 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:02.671191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 355/712] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:09:02 2022] GET /identity/v3/role_assignments?user.id=0f67502c08b84cee80f57eb194fb731b&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=aee2782258cd4ca6b1171d38e9c05add => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:02.707114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30391ab-d348-42ab-9155-a8ec23a5f0e8 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:02.707439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30391ab-d348-42ab-9155-a8ec23a5f0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:02.707718 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30391ab-d348-42ab-9155-a8ec23a5f0e8 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:02.709390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 358/713] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:02.715291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ec5bf-3b79-443c-927e-5ae4007fbbd3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:02.715584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ec5bf-3b79-443c-927e-5ae4007fbbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:02.715856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ec5bf-3b79-443c-927e-5ae4007fbbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:02.735433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-de7ec5bf-3b79-443c-927e-5ae4007fbbd3 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:02.736767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-de7ec5bf-3b79-443c-927e-5ae4007fbbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:02.804529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:02.818728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 356/714] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:03.082527 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30391ab-d348-42ab-9155-a8ec23a5f0e8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:03.190985 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30391ab-d348-42ab-9155-a8ec23a5f0e8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:03.228568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e31e1-4e47-4dc2-a9fb-290da42b4fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:03.229548 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e31e1-4e47-4dc2-a9fb-290da42b4fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:03.230019 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e31e1-4e47-4dc2-a9fb-290da42b4fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:03.230484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e31e1-4e47-4dc2-a9fb-290da42b4fa6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:03.231253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e31e1-4e47-4dc2-a9fb-290da42b4fa6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:03.232863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e31e1-4e47-4dc2-a9fb-290da42b4fa6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-5c0e31e1-4e47-4dc2-a9fb-290da42b4fa6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:03.242065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:03.243059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 21 21:09:03.243924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:03.246572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 359/715] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:09:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:03.252295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ec5bf-3b79-443c-927e-5ae4007fbbd3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:03.349623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ec5bf-3b79-443c-927e-5ae4007fbbd3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:03.387374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04817-7fb2-472c-8c96-dae81ad5a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:03.388000 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04817-7fb2-472c-8c96-dae81ad5a940 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:03.388283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04817-7fb2-472c-8c96-dae81ad5a940 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:03.388560 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04817-7fb2-472c-8c96-dae81ad5a940 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:03.389198 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c04817-7fb2-472c-8c96-dae81ad5a940 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:03.389502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c04817-7fb2-472c-8c96-dae81ad5a940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:03.390926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c04817-7fb2-472c-8c96-dae81ad5a940 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:03.397020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 357/716] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:09:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:03.402621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e31e1-4e47-4dc2-a9fb-290da42b4fa6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:03.428189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:03.523309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e31e1-4e47-4dc2-a9fb-290da42b4fa6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:03.553134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c0bb3-da61-44b3-ad2d-120861db421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:03.553741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c0bb3-da61-44b3-ad2d-120861db421c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:03.554017 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c0bb3-da61-44b3-ad2d-120861db421c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:03.554285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c0bb3-da61-44b3-ad2d-120861db421c None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:03.554967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c0bb3-da61-44b3-ad2d-120861db421c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:03.555285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c0bb3-da61-44b3-ad2d-120861db421c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:03.556706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c0bb3-da61-44b3-ad2d-120861db421c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:03.562023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 360/717] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Oct 21 21:09:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:03.568238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04817-7fb2-472c-8c96-dae81ad5a940 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:03.635711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:03.679575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04817-7fb2-472c-8c96-dae81ad5a940 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:03.715474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82b0dc-b4f3-44cb-9335-b14a423d4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:03.716079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82b0dc-b4f3-44cb-9335-b14a423d4ead None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:03.716355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82b0dc-b4f3-44cb-9335-b14a423d4ead None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:03.716626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82b0dc-b4f3-44cb-9335-b14a423d4ead None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:03.717300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82b0dc-b4f3-44cb-9335-b14a423d4ead None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:03.718641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82b0dc-b4f3-44cb-9335-b14a423d4ead None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:03.741441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 358/718] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:09:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:04.521490 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e346-49c0-4020-b4ad-830f945d24a4 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:04.521490 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e346-49c0-4020-b4ad-830f945d24a4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:04.521490 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e346-49c0-4020-b4ad-830f945d24a4 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:04.521490 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 361/719] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:04.527539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059f52-b6f2-4ba8-9bac-3e4e51cb8127 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:04.528330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059f52-b6f2-4ba8-9bac-3e4e51cb8127 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:04.528818 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059f52-b6f2-4ba8-9bac-3e4e51cb8127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:04.547385 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d5059f52-b6f2-4ba8-9bac-3e4e51cb8127 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:04.549542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d5059f52-b6f2-4ba8-9bac-3e4e51cb8127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:04.629444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 359/720] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:04.789347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbdc63-5743-4356-a51b-f0921d1ea45f None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:04.789956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbdc63-5743-4356-a51b-f0921d1ea45f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:04.791042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbdc63-5743-4356-a51b-f0921d1ea45f None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:04.792870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 362/721] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:04.798051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6d5a1-f874-444f-a92e-038c7a348baa None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:04.798341 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6d5a1-f874-444f-a92e-038c7a348baa None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:04.799129 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6d5a1-f874-444f-a92e-038c7a348baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:04.819187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-aed6d5a1-f874-444f-a92e-038c7a348baa None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:04.820420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-aed6d5a1-f874-444f-a92e-038c7a348baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:04.850515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:04.895400 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 360/722] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:04.906410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbdc63-5743-4356-a51b-f0921d1ea45f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:05.000214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:05.018501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbdc63-5743-4356-a51b-f0921d1ea45f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:05.056034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a66291-3945-468f-a3e2-beb52136dd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:05.056660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66291-3945-468f-a3e2-beb52136dd44 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:05.056940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66291-3945-468f-a3e2-beb52136dd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:05.057210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a66291-3945-468f-a3e2-beb52136dd44 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:05.057884 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a66291-3945-468f-a3e2-beb52136dd44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:05.059236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a66291-3945-468f-a3e2-beb52136dd44 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:05.076950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 363/723] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:09:04 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:05.095252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315c06f-6445-4ec4-9f47-aa91d369186a None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:05.096193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315c06f-6445-4ec4-9f47-aa91d369186a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:05.096505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315c06f-6445-4ec4-9f47-aa91d369186a None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:05.098325 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 361/724] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:05.104349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010aab3-22b5-4b6d-bce8-f3c50260d843 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:05.104643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010aab3-22b5-4b6d-bce8-f3c50260d843 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:05.104967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010aab3-22b5-4b6d-bce8-f3c50260d843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:05.124803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f010aab3-22b5-4b6d-bce8-f3c50260d843 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:05.126053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f010aab3-22b5-4b6d-bce8-f3c50260d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:05.176429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315c06f-6445-4ec4-9f47-aa91d369186a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:05.216387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 364/725] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:05.297775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315c06f-6445-4ec4-9f47-aa91d369186a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:05.335887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7e2af-ec2c-4738-a4de-0c9658f001d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:05.336453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7e2af-ec2c-4738-a4de-0c9658f001d1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:05.336734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7e2af-ec2c-4738-a4de-0c9658f001d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:05.337012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7e2af-ec2c-4738-a4de-0c9658f001d1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:05.337595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7e2af-ec2c-4738-a4de-0c9658f001d1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:05.338959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7e2af-ec2c-4738-a4de-0c9658f001d1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-e8a7e2af-ec2c-4738-a4de-0c9658f001d1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:05.348631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:05.349586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:05.350462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:05.354661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 362/726] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:09:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:09:05.356090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010aab3-22b5-4b6d-bce8-f3c50260d843 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:05.427701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:05.459909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010aab3-22b5-4b6d-bce8-f3c50260d843 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:05.496406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e257-8ae8-4797-86cd-ce58a47640c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:05.496878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e257-8ae8-4797-86cd-ce58a47640c2 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:05.497167 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e257-8ae8-4797-86cd-ce58a47640c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:05.497371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7e2af-ec2c-4738-a4de-0c9658f001d1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:05.497471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e257-8ae8-4797-86cd-ce58a47640c2 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:05.498178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e257-8ae8-4797-86cd-ce58a47640c2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:05.498485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e257-8ae8-4797-86cd-ce58a47640c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:05.499886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e257-8ae8-4797-86cd-ce58a47640c2 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:05.507359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 365/727] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:09:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:05.513523 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e257-8ae8-4797-86cd-ce58a47640c2 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:05.534778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:05.620661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7e2af-ec2c-4738-a4de-0c9658f001d1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:05.643648 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e257-8ae8-4797-86cd-ce58a47640c2 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:05.667764 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558558e6-3e05-4704-af59-3b6eba58806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:05.669011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558558e6-3e05-4704-af59-3b6eba58806e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:05.669895 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558558e6-3e05-4704-af59-3b6eba58806e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:05.670620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558558e6-3e05-4704-af59-3b6eba58806e None admin] PATH_INFO: `/v3/services/image` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:05.671674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558558e6-3e05-4704-af59-3b6eba58806e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:05.674541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558558e6-3e05-4704-af59-3b6eba58806e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:05.680609 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35969e76-eaa8-495d-9f64-d69ac00665c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:05.681217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969e76-eaa8-495d-9f64-d69ac00665c4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:05.681491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969e76-eaa8-495d-9f64-d69ac00665c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:05.681763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969e76-eaa8-495d-9f64-d69ac00665c4 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:05.682392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35969e76-eaa8-495d-9f64-d69ac00665c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:05.682687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35969e76-eaa8-495d-9f64-d69ac00665c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:05.684062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35969e76-eaa8-495d-9f64-d69ac00665c4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:05.685418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-558558e6-3e05-4704-af59-3b6eba58806e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:05.688019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:05.688992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 21 21:09:05.690011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:05.695319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 363/728] 10.222.0.23 () {56 vars in 1105 bytes} [Fri Oct 21 21:09:05 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:05.699710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 366/729] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:09:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:05.700211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558558e6-3e05-4704-af59-3b6eba58806e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:05.708260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35969e76-eaa8-495d-9f64-d69ac00665c4 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:05.802253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:05.810817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558558e6-3e05-4704-af59-3b6eba58806e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:05.813986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35969e76-eaa8-495d-9f64-d69ac00665c4 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:05.847675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea8a11-8139-43ed-bdc6-f4022ac58f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:05.848614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea8a11-8139-43ed-bdc6-f4022ac58f5c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:05.849067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea8a11-8139-43ed-bdc6-f4022ac58f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:05.849547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea8a11-8139-43ed-bdc6-f4022ac58f5c None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:05.850346 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea8a11-8139-43ed-bdc6-f4022ac58f5c None admin] RBAC: Adding query filter params (name=image) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:05.850816 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea8a11-8139-43ed-bdc6-f4022ac58f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:05.850931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab086fe-5b6f-4620-a320-35c5a99d24e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:05.851557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab086fe-5b6f-4620-a320-35c5a99d24e7 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:05.851842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab086fe-5b6f-4620-a320-35c5a99d24e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:05.852117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab086fe-5b6f-4620-a320-35c5a99d24e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:05.852791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab086fe-5b6f-4620-a320-35c5a99d24e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:05.853228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea8a11-8139-43ed-bdc6-f4022ac58f5c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:05.854133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab086fe-5b6f-4620-a320-35c5a99d24e7 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:05.863338 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 364/730] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:05.864447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea8a11-8139-43ed-bdc6-f4022ac58f5c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:05.883556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 367/731] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:09:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:05.978888 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea8a11-8139-43ed-bdc6-f4022ac58f5c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:06.028091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea6237-c386-4489-8345-fc04d87a2caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:06.029054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea6237-c386-4489-8345-fc04d87a2caf None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:06.029521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea6237-c386-4489-8345-fc04d87a2caf None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:06.029969 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea6237-c386-4489-8345-fc04d87a2caf None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:06.030831 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea6237-c386-4489-8345-fc04d87a2caf None admin] RBAC: Adding query filter params (type=image) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:06.031357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea6237-c386-4489-8345-fc04d87a2caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:06.032936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea6237-c386-4489-8345-fc04d87a2caf None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:06.038633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 365/732] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:06.123296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7826a1-15d5-4189-a7bf-c2af35b1cba1 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:06.123598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7826a1-15d5-4189-a7bf-c2af35b1cba1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:06.123876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7826a1-15d5-4189-a7bf-c2af35b1cba1 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:06.125532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 368/733] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:06.131158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94741cb9-8cbe-4493-b846-947d52d58f60 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:06.131466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94741cb9-8cbe-4493-b846-947d52d58f60 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:06.131740 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94741cb9-8cbe-4493-b846-947d52d58f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:06.151923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-94741cb9-8cbe-4493-b846-947d52d58f60 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:06.153042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-94741cb9-8cbe-4493-b846-947d52d58f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:06.168842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:06.229242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 366/734] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:06.497992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7826a1-15d5-4189-a7bf-c2af35b1cba1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:06.556263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:06.605861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7826a1-15d5-4189-a7bf-c2af35b1cba1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:06.640738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:06.641357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:06.641640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:06.641920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:06.642590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:06.644048 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:06.646645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WARNING keystone.server.flask.common [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 21 21:09:06.664947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.sql.core [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 21 21:09:06.664947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 21 21:09:06.664947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [parameters: {'id': '5d5eca02fb864fb9aac0c88a91298b9f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 21 21:09:06.664947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81348) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5d5eca02fb864fb9aac0c88a91298b9f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5d5eca02fb864fb9aac0c88a91298b9f. Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 21 21:09:06.672385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 21 21:09:06.673185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application yield resource Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.rollback() Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.force_reraise() Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise self.value Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application session.commit() Oct 21 21:09:06.675433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._prepare_impl() Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.flush() Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._flush(objects) Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application compat.raise_( Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application flush_context.execute() Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 21 21:09:06.676692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rec.execute(self) Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 21 21:09:06.677940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 21 21:09:06.678970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [parameters: {'id': '5d5eca02fb864fb9aac0c88a91298b9f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:06.680424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:06.681823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:06.688987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:06.688987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 21 21:09:06.688987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 21 21:09:06.688987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:06.688987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:06.688987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 21 21:09:06.688987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 21 21:09:06.688987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5d5eca02fb864fb9aac0c88a91298b9f. Oct 21 21:09:06.688987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:06.688987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 369/735] 10.222.0.23 () {60 vars in 1140 bytes} [Fri Oct 21 21:09:06 2022] POST /identity/v3/projects => generated 262 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:06.690857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94741cb9-8cbe-4493-b846-947d52d58f60 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:06.789653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94741cb9-8cbe-4493-b846-947d52d58f60 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:06.824958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abece880-c3a9-4cd8-b112-85afb27cbae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:06.825588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece880-c3a9-4cd8-b112-85afb27cbae3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:06.825862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece880-c3a9-4cd8-b112-85afb27cbae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:06.826132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece880-c3a9-4cd8-b112-85afb27cbae3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:06.832964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abece880-c3a9-4cd8-b112-85afb27cbae3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:06.834393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abece880-c3a9-4cd8-b112-85afb27cbae3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-abece880-c3a9-4cd8-b112-85afb27cbae3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:09:06.845782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:06.847826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:06.849896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:09:06.849896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:09:06.849896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:09:06.849896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:09:06.849896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:09:06.849896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:09:06.849896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:09:06.849896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:06.849896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 367/736] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:06.856999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:06.967320 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fee99-7e42-4663-91da-040726f17d9a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:06.980784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:07.003892 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7dea6-8e7d-491c-8676-647b7777ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:07.004507 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7dea6-8e7d-491c-8676-647b7777ad7e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:07.004789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7dea6-8e7d-491c-8676-647b7777ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:07.005064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7dea6-8e7d-491c-8676-647b7777ad7e None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:07.005736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7dea6-8e7d-491c-8676-647b7777ad7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:07.006044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7dea6-8e7d-491c-8676-647b7777ad7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:07.007702 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7dea6-8e7d-491c-8676-647b7777ad7e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:07.029002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 370/737] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:09:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:07.369667 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32bc9-1025-44e3-958b-89b8a9b37f4b None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:07.370017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32bc9-1025-44e3-958b-89b8a9b37f4b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:07.370188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32bc9-1025-44e3-958b-89b8a9b37f4b None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:07.371729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 368/738] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:07.377631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643dee5-a65d-4979-8484-497194f6a846 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:07.377916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643dee5-a65d-4979-8484-497194f6a846 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:07.378192 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643dee5-a65d-4979-8484-497194f6a846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:07.397542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c643dee5-a65d-4979-8484-497194f6a846 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:07.399039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c643dee5-a65d-4979-8484-497194f6a846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:07.471676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 371/739] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:09:07.736770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d32bc9-1025-44e3-958b-89b8a9b37f4b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:07.749050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:07.850751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d32bc9-1025-44e3-958b-89b8a9b37f4b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:07.885931 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbc216-ba27-4a64-b95d-f0032f8bf27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:07.886558 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbc216-ba27-4a64-b95d-f0032f8bf27a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:07.886837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbc216-ba27-4a64-b95d-f0032f8bf27a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:07.887110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbc216-ba27-4a64-b95d-f0032f8bf27a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:07.887716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbc216-ba27-4a64-b95d-f0032f8bf27a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:07.889069 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbc216-ba27-4a64-b95d-f0032f8bf27a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-69cbc216-ba27-4a64-b95d-f0032f8bf27a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:07.898008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:07.900231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:07.902149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 369/740] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:09:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:07.907525 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643dee5-a65d-4979-8484-497194f6a846 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:08.010837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:08.014277 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643dee5-a65d-4979-8484-497194f6a846 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:08.056978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97294ef7-1950-4105-8c68-6249fdc953e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:08.057245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294ef7-1950-4105-8c68-6249fdc953e0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.057436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294ef7-1950-4105-8c68-6249fdc953e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.061190 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294ef7-1950-4105-8c68-6249fdc953e0 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.061190 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97294ef7-1950-4105-8c68-6249fdc953e0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:08.061190 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97294ef7-1950-4105-8c68-6249fdc953e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:08.061190 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97294ef7-1950-4105-8c68-6249fdc953e0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:08.065612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 372/741] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:09:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:08.072914 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbc216-ba27-4a64-b95d-f0032f8bf27a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:08.153478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:08.189832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbc216-ba27-4a64-b95d-f0032f8bf27a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:08.224464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2ba6-e819-4636-aa97-ce10d0154af6 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.224743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2ba6-e819-4636-aa97-ce10d0154af6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.225016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2ba6-e819-4636-aa97-ce10d0154af6 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.226493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 373/742] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:08.230610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf811bf-4044-43ae-a26f-9b4c447ed222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:08.231460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf811bf-4044-43ae-a26f-9b4c447ed222 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.231575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f0b56-c577-44a2-a68e-50a8350d9073 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.231953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f0b56-c577-44a2-a68e-50a8350d9073 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.232229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf811bf-4044-43ae-a26f-9b4c447ed222 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.232421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f0b56-c577-44a2-a68e-50a8350d9073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.232780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf811bf-4044-43ae-a26f-9b4c447ed222 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.233541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf811bf-4044-43ae-a26f-9b4c447ed222 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:08.233988 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf811bf-4044-43ae-a26f-9b4c447ed222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:08.235514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf811bf-4044-43ae-a26f-9b4c447ed222 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:08.241989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 370/743] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:09:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:08.247978 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf811bf-4044-43ae-a26f-9b4c447ed222 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:08.253801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0e3f0b56-c577-44a2-a68e-50a8350d9073 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:08.255088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0e3f0b56-c577-44a2-a68e-50a8350d9073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:08.334105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 374/744] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:08.340834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0566ee6-02a9-41ed-bcfa-9f1f2571033e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.341668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0566ee6-02a9-41ed-bcfa-9f1f2571033e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.342119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0566ee6-02a9-41ed-bcfa-9f1f2571033e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.343842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 375/745] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:08.352013 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704575e-1466-401b-8a4b-a1611813a2dd None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.352768 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704575e-1466-401b-8a4b-a1611813a2dd None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.353222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704575e-1466-401b-8a4b-a1611813a2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.359363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf811bf-4044-43ae-a26f-9b4c447ed222 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:08.377987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b704575e-1466-401b-8a4b-a1611813a2dd None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:08.379852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b704575e-1466-401b-8a4b-a1611813a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:08.396595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317cd35-dfa8-436b-8bc7-d05905ffc310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:08.397331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cd35-dfa8-436b-8bc7-d05905ffc310 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.397677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cd35-dfa8-436b-8bc7-d05905ffc310 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.398016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cd35-dfa8-436b-8bc7-d05905ffc310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.398779 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317cd35-dfa8-436b-8bc7-d05905ffc310 None admin] RBAC: Adding query filter params (interface=public, service_id=3d59e03c53f44112bff2eba839eb3b69, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:08.399152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317cd35-dfa8-436b-8bc7-d05905ffc310 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:08.400602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317cd35-dfa8-436b-8bc7-d05905ffc310 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:08.403529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:08.414380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 371/746] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 21 21:09:08 2022] GET /identity/v3/endpoints?service_id=3d59e03c53f44112bff2eba839eb3b69&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:08.415505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317cd35-dfa8-436b-8bc7-d05905ffc310 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:08.480758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 376/747] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:08.520919 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317cd35-dfa8-436b-8bc7-d05905ffc310 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:08.556078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c5033-7bb4-4c6a-8001-daa5b9cf6196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:08.556993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c5033-7bb4-4c6a-8001-daa5b9cf6196 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.557467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c5033-7bb4-4c6a-8001-daa5b9cf6196 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.557934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c5033-7bb4-4c6a-8001-daa5b9cf6196 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.558739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c5033-7bb4-4c6a-8001-daa5b9cf6196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:08.560307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c5033-7bb4-4c6a-8001-daa5b9cf6196 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:08.567778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 372/748] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 21 21:09:08 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:09:08.608389 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704575e-1466-401b-8a4b-a1611813a2dd None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:08.636977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:08.725693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704575e-1466-401b-8a4b-a1611813a2dd None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:08.749666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c5033-7bb4-4c6a-8001-daa5b9cf6196 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:08.770358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90164a-8971-4156-8ed7-6327511cee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:08.771571 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90164a-8971-4156-8ed7-6327511cee82 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.771990 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90164a-8971-4156-8ed7-6327511cee82 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.772397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90164a-8971-4156-8ed7-6327511cee82 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.772995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90164a-8971-4156-8ed7-6327511cee82 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:08.774781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90164a-8971-4156-8ed7-6327511cee82 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-0f90164a-8971-4156-8ed7-6327511cee82 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:08.786500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:08.787626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:08.788482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 377/749] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:09:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:08.794199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90164a-8971-4156-8ed7-6327511cee82 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:08.837858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:08.883150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c5033-7bb4-4c6a-8001-daa5b9cf6196 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:08.906827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:08.921159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5610db4-a63a-4171-9bd2-1b1ae25667f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:08.921708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90164a-8971-4156-8ed7-6327511cee82 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:08.922662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5610db4-a63a-4171-9bd2-1b1ae25667f7 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.923150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5610db4-a63a-4171-9bd2-1b1ae25667f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.923697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5610db4-a63a-4171-9bd2-1b1ae25667f7 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.924546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5610db4-a63a-4171-9bd2-1b1ae25667f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:08.926249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5610db4-a63a-4171-9bd2-1b1ae25667f7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:08.945299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 373/750] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:09:08 2022] POST /identity/v3/services => generated 242 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:08.976484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0469-38d9-4ce5-8e03-4f24ffdccde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:08.977579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0469-38d9-4ce5-8e03-4f24ffdccde3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:08.978067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0469-38d9-4ce5-8e03-4f24ffdccde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:08.978587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0469-38d9-4ce5-8e03-4f24ffdccde3 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:08.979583 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb0469-38d9-4ce5-8e03-4f24ffdccde3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:08.980105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb0469-38d9-4ce5-8e03-4f24ffdccde3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:08.981832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb0469-38d9-4ce5-8e03-4f24ffdccde3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:08.993957 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 378/751] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:09:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:08.996240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5610db4-a63a-4171-9bd2-1b1ae25667f7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:09.123480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5610db4-a63a-4171-9bd2-1b1ae25667f7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:09.153796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:09.168896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435f30-a23e-4722-8df9-fd9eab544794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:09.169536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435f30-a23e-4722-8df9-fd9eab544794 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:09.169814 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435f30-a23e-4722-8df9-fd9eab544794 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:09.170085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435f30-a23e-4722-8df9-fd9eab544794 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:09.170720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435f30-a23e-4722-8df9-fd9eab544794 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:09.171019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435f30-a23e-4722-8df9-fd9eab544794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:09.172446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435f30-a23e-4722-8df9-fd9eab544794 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:09.178253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 374/752] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:09:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:09.184050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0469-38d9-4ce5-8e03-4f24ffdccde3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:09.258910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab9173-111b-4ee8-b62a-4b24fd40268c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:09.259191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab9173-111b-4ee8-b62a-4b24fd40268c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:09.259508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab9173-111b-4ee8-b62a-4b24fd40268c None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:09.261093 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 375/753] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:09:09.266056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d689be-f9d3-46f5-ae32-2194ac53337b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:09.266339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d689be-f9d3-46f5-ae32-2194ac53337b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:09.266615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d689be-f9d3-46f5-ae32-2194ac53337b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:09.286390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-46d689be-f9d3-46f5-ae32-2194ac53337b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:09.287618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-46d689be-f9d3-46f5-ae32-2194ac53337b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:09.297890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0469-38d9-4ce5-8e03-4f24ffdccde3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:09.339705 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff033306-7aca-483e-ba48-d53d03a017c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:09.340676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff033306-7aca-483e-ba48-d53d03a017c1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:09.341026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff033306-7aca-483e-ba48-d53d03a017c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:09.341402 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff033306-7aca-483e-ba48-d53d03a017c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:09.342307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff033306-7aca-483e-ba48-d53d03a017c1 None admin] RBAC: Adding query filter params (interface=admin, service_id=711e3e4d07184e2297e69f2ddffe2eb1, region_id=RegionOne) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:09.342621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff033306-7aca-483e-ba48-d53d03a017c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:09.344751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff033306-7aca-483e-ba48-d53d03a017c1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:09.353853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 379/754] 10.222.0.23 () {56 vars in 1249 bytes} [Fri Oct 21 21:09:09 2022] GET /identity/v3/endpoints?service_id=711e3e4d07184e2297e69f2ddffe2eb1&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:09.359358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff033306-7aca-483e-ba48-d53d03a017c1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:09.368180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 376/755] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:09 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:09:09.375385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:09.471203 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff033306-7aca-483e-ba48-d53d03a017c1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:09.508359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec3748-dd18-4ca9-abc9-ce49a97b1742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:09.508997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3748-dd18-4ca9-abc9-ce49a97b1742 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:09.509277 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3748-dd18-4ca9-abc9-ce49a97b1742 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:09.509551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3748-dd18-4ca9-abc9-ce49a97b1742 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:09.510173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec3748-dd18-4ca9-abc9-ce49a97b1742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:09.511698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec3748-dd18-4ca9-abc9-ce49a97b1742 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:09.520253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 380/756] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 21 21:09:09 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:09:09.641161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d689be-f9d3-46f5-ae32-2194ac53337b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:09.747096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d689be-f9d3-46f5-ae32-2194ac53337b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:09.768398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:09.786799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:09.787450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:09.787726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:09.787995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:09.788636 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:09.790062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:09.792642 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING keystone.server.flask.common [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 21 21:09:09.806920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.sql.core [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 21 21:09:09.806920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 21 21:09:09.806920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [parameters: {'user_id': '990e61cde11842b7aed69a20efabeea8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 21 21:09:09.806920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81347) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result = self._query(query) Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application conn.query(q) Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result.read() Oct 21 21:09:09.814044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 21 21:09:09.815498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application next(self.gen) Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application yield resource Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application next(self.gen) Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.session.rollback() Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.force_reraise() Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise self.value Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application session.commit() Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 21 21:09:09.816435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._prepare_impl() Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.session.flush() Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._flush(objects) Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application compat.raise_( Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application flush_context.execute() Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rec.execute(self) Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 21 21:09:09.817308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 21 21:09:09.818212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result = self._query(query) Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application conn.query(q) Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result.read() Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 21 21:09:09.819052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [parameters: {'user_id': '990e61cde11842b7aed69a20efabeea8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:09.821582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 21 21:09:09.827575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 21 21:09:09.828591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 21 21:09:09.828591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 21 21:09:09.828591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 21 21:09:09.828591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 21 21:09:09.828591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 21 21:09:09.828591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:09.828591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 377/757] 10.222.0.23 () {60 vars in 1131 bytes} [Fri Oct 21 21:09:09 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:09.828976 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec3748-dd18-4ca9-abc9-ce49a97b1742 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:09.910641 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:09.935694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec3748-dd18-4ca9-abc9-ce49a97b1742 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:09.970852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed804d-e2d8-462c-a0a7-b1dfb5de7ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:09.971508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed804d-e2d8-462c-a0a7-b1dfb5de7ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:09.971790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed804d-e2d8-462c-a0a7-b1dfb5de7ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:09.972064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed804d-e2d8-462c-a0a7-b1dfb5de7ea1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:09.979995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed804d-e2d8-462c-a0a7-b1dfb5de7ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:09.981463 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed804d-e2d8-462c-a0a7-b1dfb5de7ea1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-3fed804d-e2d8-462c-a0a7-b1dfb5de7ea1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:09:09.994912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:09.996142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:09.997392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 381/758] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:09:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:10.004858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:10.119498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8379-537b-4e42-936a-4ea0e991aba7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:10.154577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca85dc2-3d1e-467b-9980-f9b0c9a67ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:10.155190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca85dc2-3d1e-467b-9980-f9b0c9a67ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:10.155491 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca85dc2-3d1e-467b-9980-f9b0c9a67ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:10.155760 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca85dc2-3d1e-467b-9980-f9b0c9a67ea0 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:10.156454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca85dc2-3d1e-467b-9980-f9b0c9a67ea0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:10.156750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca85dc2-3d1e-467b-9980-f9b0c9a67ea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:10.158968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca85dc2-3d1e-467b-9980-f9b0c9a67ea0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:10.198023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 378/759] 10.222.0.23 () {56 vars in 1101 bytes} [Fri Oct 21 21:09:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:10.791518 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aadde-e60b-4084-af4d-13c9d1500140 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:10.791899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aadde-e60b-4084-af4d-13c9d1500140 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:10.792101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aadde-e60b-4084-af4d-13c9d1500140 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:10.793435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 382/760] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:10.799566 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011805be-90cd-46f6-bd92-e8fea8ad42d4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:10.800018 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011805be-90cd-46f6-bd92-e8fea8ad42d4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:10.800194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011805be-90cd-46f6-bd92-e8fea8ad42d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:10.819167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-011805be-90cd-46f6-bd92-e8fea8ad42d4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:10.820695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-011805be-90cd-46f6-bd92-e8fea8ad42d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:10.852058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:10.892337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 379/761] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:10 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:11.156083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aadde-e60b-4084-af4d-13c9d1500140 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:11.259582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aadde-e60b-4084-af4d-13c9d1500140 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:11.285057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3943-912f-4597-8a19-935105153881 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:11.285457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3943-912f-4597-8a19-935105153881 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:11.285734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3943-912f-4597-8a19-935105153881 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:11.287258 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 380/762] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:09:11.291998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0064a-b8e8-4e5f-ace3-b81a236d23cc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:11.292285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0064a-b8e8-4e5f-ace3-b81a236d23cc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:11.292563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0064a-b8e8-4e5f-ace3-b81a236d23cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:11.293425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfb639-e404-4228-ad93-d19d425ed95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:11.294260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfb639-e404-4228-ad93-d19d425ed95e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:11.294728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfb639-e404-4228-ad93-d19d425ed95e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:11.295171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfb639-e404-4228-ad93-d19d425ed95e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:11.295953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfb639-e404-4228-ad93-d19d425ed95e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:11.297486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfb639-e404-4228-ad93-d19d425ed95e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:11.302104 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9dbfb639-e404-4228-ad93-d19d425ed95e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:11.310893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:11.311938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 21 21:09:11.312803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:11.313541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d6c0064a-b8e8-4e5f-ace3-b81a236d23cc None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:11.313541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d6c0064a-b8e8-4e5f-ace3-b81a236d23cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:11.313681 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 383/763] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:09:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:11.319200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfb639-e404-4228-ad93-d19d425ed95e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:11.392062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 381/764] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:11 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:09:11.426337 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfb639-e404-4228-ad93-d19d425ed95e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:11.460239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc3b11-3efa-41ab-b802-eebaa9e1e35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:11.461050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc3b11-3efa-41ab-b802-eebaa9e1e35d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:11.461470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc3b11-3efa-41ab-b802-eebaa9e1e35d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:11.461889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc3b11-3efa-41ab-b802-eebaa9e1e35d None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:11.462644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc3b11-3efa-41ab-b802-eebaa9e1e35d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:11.463096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc3b11-3efa-41ab-b802-eebaa9e1e35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:11.464628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc3b11-3efa-41ab-b802-eebaa9e1e35d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:11.469972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 384/765] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:09:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:11.475569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0064a-b8e8-4e5f-ace3-b81a236d23cc None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:11.571695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:11.578094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0064a-b8e8-4e5f-ace3-b81a236d23cc None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:11.614307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179248e8-b824-4f7c-92f5-739a260200f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:11.615232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179248e8-b824-4f7c-92f5-739a260200f4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:11.615742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179248e8-b824-4f7c-92f5-739a260200f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:11.616277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179248e8-b824-4f7c-92f5-739a260200f4 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:11.617090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179248e8-b824-4f7c-92f5-739a260200f4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:11.617605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179248e8-b824-4f7c-92f5-739a260200f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:11.619130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179248e8-b824-4f7c-92f5-739a260200f4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:11.624419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 382/766] 10.222.0.23 () {56 vars in 1112 bytes} [Fri Oct 21 21:09:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:11.630097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc3b11-3efa-41ab-b802-eebaa9e1e35d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:11.665726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179248e8-b824-4f7c-92f5-739a260200f4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:11.703118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:11.745019 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc3b11-3efa-41ab-b802-eebaa9e1e35d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:11.779922 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179248e8-b824-4f7c-92f5-739a260200f4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:11.780193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3151f1-8cf1-4aae-a32a-efcb3cbee5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:11.780817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3151f1-8cf1-4aae-a32a-efcb3cbee5e4 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:11.781104 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3151f1-8cf1-4aae-a32a-efcb3cbee5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:11.781379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3151f1-8cf1-4aae-a32a-efcb3cbee5e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:11.782047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3151f1-8cf1-4aae-a32a-efcb3cbee5e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:11.783992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3151f1-8cf1-4aae-a32a-efcb3cbee5e4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:11.806963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 385/767] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:09:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:09:11.809082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d693de8-d361-4994-aa6c-0e152c16769b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:11.809423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d693de8-d361-4994-aa6c-0e152c16769b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:11.809707 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d693de8-d361-4994-aa6c-0e152c16769b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:11.810981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 386/768] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:11.817122 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8ee3-e4ba-47b8-85d5-e029d034ad45 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:11.818047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8ee3-e4ba-47b8-85d5-e029d034ad45 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:11.818332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8ee3-e4ba-47b8-85d5-e029d034ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:11.822792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be844f36-fea4-4c9f-b7b1-4c421aee843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:11.823357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be844f36-fea4-4c9f-b7b1-4c421aee843a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:11.823639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be844f36-fea4-4c9f-b7b1-4c421aee843a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:11.824173 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be844f36-fea4-4c9f-b7b1-4c421aee843a None admin] PATH_INFO: `/v3/services/image` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:11.824762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be844f36-fea4-4c9f-b7b1-4c421aee843a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:11.826183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be844f36-fea4-4c9f-b7b1-4c421aee843a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-be844f36-fea4-4c9f-b7b1-4c421aee843a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:11.836005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:11.837215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:11.838096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 383/769] 10.222.0.23 () {56 vars in 1105 bytes} [Fri Oct 21 21:09:11 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:09:11.840910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6f4c8ee3-e4ba-47b8-85d5-e029d034ad45 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:11.842319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6f4c8ee3-e4ba-47b8-85d5-e029d034ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:11.843257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be844f36-fea4-4c9f-b7b1-4c421aee843a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:11.874364 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:11.928789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 387/770] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:11 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:09:11.957196 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be844f36-fea4-4c9f-b7b1-4c421aee843a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:11.998263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05ee15-7bd9-43e6-b56a-7a12dd06919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:11.998968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ee15-7bd9-43e6-b56a-7a12dd06919d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:11.999356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ee15-7bd9-43e6-b56a-7a12dd06919d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:11.999704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ee15-7bd9-43e6-b56a-7a12dd06919d None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:12.000411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05ee15-7bd9-43e6-b56a-7a12dd06919d None admin] RBAC: Adding query filter params (name=image) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:12.000796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05ee15-7bd9-43e6-b56a-7a12dd06919d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:12.002173 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05ee15-7bd9-43e6-b56a-7a12dd06919d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:12.007433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 384/771] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:12.013232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8ee3-e4ba-47b8-85d5-e029d034ad45 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:12.068705 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:12.123143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8ee3-e4ba-47b8-85d5-e029d034ad45 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:12.157723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf01419-05cd-4c76-9421-9fdb76f0b6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:12.158945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf01419-05cd-4c76-9421-9fdb76f0b6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:12.159312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf01419-05cd-4c76-9421-9fdb76f0b6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:12.159660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf01419-05cd-4c76-9421-9fdb76f0b6b4 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:12.160356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf01419-05cd-4c76-9421-9fdb76f0b6b4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:12.160728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf01419-05cd-4c76-9421-9fdb76f0b6b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:12.162253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf01419-05cd-4c76-9421-9fdb76f0b6b4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:12.171427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 388/772] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:12.173348 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05ee15-7bd9-43e6-b56a-7a12dd06919d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:12.207175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf01419-05cd-4c76-9421-9fdb76f0b6b4 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:12.262018 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:12.279579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05ee15-7bd9-43e6-b56a-7a12dd06919d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:12.317057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af85ff6-351e-4e25-9d6a-0dfbc08a0d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:12.317669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af85ff6-351e-4e25-9d6a-0dfbc08a0d8d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:12.317947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af85ff6-351e-4e25-9d6a-0dfbc08a0d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:12.318409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af85ff6-351e-4e25-9d6a-0dfbc08a0d8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:12.318919 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af85ff6-351e-4e25-9d6a-0dfbc08a0d8d None admin] RBAC: Adding query filter params (interface=public, service_id=11a0308c71b84e7b88938bf5d52d6838, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:12.319228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af85ff6-351e-4e25-9d6a-0dfbc08a0d8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:12.320713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af85ff6-351e-4e25-9d6a-0dfbc08a0d8d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:12.324678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf01419-05cd-4c76-9421-9fdb76f0b6b4 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:12.331579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 385/773] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 21 21:09:12 2022] GET /identity/v3/endpoints?service_id=11a0308c71b84e7b88938bf5d52d6838&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:12.332445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af85ff6-351e-4e25-9d6a-0dfbc08a0d8d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:12.342478 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:12.365042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671fcc8-3b64-43a8-978b-2fe917829cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:12.365682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671fcc8-3b64-43a8-978b-2fe917829cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:12.365963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671fcc8-3b64-43a8-978b-2fe917829cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:12.366240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671fcc8-3b64-43a8-978b-2fe917829cf5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:12.366829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671fcc8-3b64-43a8-978b-2fe917829cf5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:12.368218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671fcc8-3b64-43a8-978b-2fe917829cf5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9671fcc8-3b64-43a8-978b-2fe917829cf5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:12.377788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:12.378973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 21 21:09:12.380023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:12.381599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 389/774] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Oct 21 21:09:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:12.387211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671fcc8-3b64-43a8-978b-2fe917829cf5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:12.446897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af85ff6-351e-4e25-9d6a-0dfbc08a0d8d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:12.480651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0484f20-93c0-4056-9f75-c6d3ee3032c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:12.481255 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0484f20-93c0-4056-9f75-c6d3ee3032c0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:12.481530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0484f20-93c0-4056-9f75-c6d3ee3032c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:12.481801 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0484f20-93c0-4056-9f75-c6d3ee3032c0 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:12.482386 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0484f20-93c0-4056-9f75-c6d3ee3032c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:12.483792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0484f20-93c0-4056-9f75-c6d3ee3032c0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:12.490583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 386/775] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 21 21:09:12 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:09:12.495403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671fcc8-3b64-43a8-978b-2fe917829cf5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:12.534357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369a19-a728-4162-a292-0d14d199f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:12.535079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369a19-a728-4162-a292-0d14d199f8ff None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:12.535453 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369a19-a728-4162-a292-0d14d199f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:12.535791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369a19-a728-4162-a292-0d14d199f8ff None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:12.536495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe369a19-a728-4162-a292-0d14d199f8ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:12.536863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe369a19-a728-4162-a292-0d14d199f8ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:12.538297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe369a19-a728-4162-a292-0d14d199f8ff None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:12.548977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 390/776] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:09:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:12.550967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0484f20-93c0-4056-9f75-c6d3ee3032c0 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:12.569516 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:12.666223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0484f20-93c0-4056-9f75-c6d3ee3032c0 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:12.702930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb87d5-5a8b-4826-ad8d-b9059919685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:12.703623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb87d5-5a8b-4826-ad8d-b9059919685f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:12.703906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb87d5-5a8b-4826-ad8d-b9059919685f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:12.704181 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb87d5-5a8b-4826-ad8d-b9059919685f None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:12.705366 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb87d5-5a8b-4826-ad8d-b9059919685f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:12.705680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb87d5-5a8b-4826-ad8d-b9059919685f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:12.707099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb87d5-5a8b-4826-ad8d-b9059919685f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:12.712530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 387/777] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Oct 21 21:09:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:12.718481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369a19-a728-4162-a292-0d14d199f8ff None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:12.764075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:12.825919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369a19-a728-4162-a292-0d14d199f8ff None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:12.858935 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdf5e1-af73-4ec1-9cdb-975b92fd7c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:12.859656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdf5e1-af73-4ec1-9cdb-975b92fd7c61 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:12.859941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdf5e1-af73-4ec1-9cdb-975b92fd7c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:12.860285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdf5e1-af73-4ec1-9cdb-975b92fd7c61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:12.861528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdf5e1-af73-4ec1-9cdb-975b92fd7c61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:12.862900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdf5e1-af73-4ec1-9cdb-975b92fd7c61 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:12.879859 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 391/778] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:09:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:09:14.040797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5cbd3-1c87-4dfe-aec1-872e05a54016 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:14.041319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5cbd3-1c87-4dfe-aec1-872e05a54016 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:14.041319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5cbd3-1c87-4dfe-aec1-872e05a54016 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:14.042824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 388/779] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:14.051056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a6dab-86a4-4f8f-a3e4-53cfdb86f7ce None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:14.051056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a6dab-86a4-4f8f-a3e4-53cfdb86f7ce None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:14.051056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a6dab-86a4-4f8f-a3e4-53cfdb86f7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:14.067565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-381a6dab-86a4-4f8f-a3e4-53cfdb86f7ce None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:14.068736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-381a6dab-86a4-4f8f-a3e4-53cfdb86f7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:14.143574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 392/780] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:14.409227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5cbd3-1c87-4dfe-aec1-872e05a54016 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:14.487685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:14.512165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5cbd3-1c87-4dfe-aec1-872e05a54016 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:14.550494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aaa93-1036-44f0-987b-0273ae553be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:14.551124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aaa93-1036-44f0-987b-0273ae553be1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:14.551429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aaa93-1036-44f0-987b-0273ae553be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:14.551698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aaa93-1036-44f0-987b-0273ae553be1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:14.563515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1aaa93-1036-44f0-987b-0273ae553be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-ff1aaa93-1036-44f0-987b-0273ae553be1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:09:14.568235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:14.569154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:14.572310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 389/781] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 21 21:09:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:14.575662 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a6dab-86a4-4f8f-a3e4-53cfdb86f7ce None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:14.605144 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:14.633706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc9512-645d-4e49-849d-78d43f9258e6 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:14.633991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc9512-645d-4e49-849d-78d43f9258e6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:14.634269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc9512-645d-4e49-849d-78d43f9258e6 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:14.635808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 390/782] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:14.640473 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6334ff-9a30-492a-8814-36431c695e4f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:14.640758 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6334ff-9a30-492a-8814-36431c695e4f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:14.641035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6334ff-9a30-492a-8814-36431c695e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:14.660354 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8b6334ff-9a30-492a-8814-36431c695e4f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:14.661449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8b6334ff-9a30-492a-8814-36431c695e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:14.683352 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a6dab-86a4-4f8f-a3e4-53cfdb86f7ce None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:14.718929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb564ea-0d81-4925-85c8-611da08ff84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:14.719568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb564ea-0d81-4925-85c8-611da08ff84f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:14.719851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb564ea-0d81-4925-85c8-611da08ff84f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:14.720120 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb564ea-0d81-4925-85c8-611da08ff84f None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:14.720807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb564ea-0d81-4925-85c8-611da08ff84f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:14.721105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb564ea-0d81-4925-85c8-611da08ff84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:14.722454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb564ea-0d81-4925-85c8-611da08ff84f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:14.731308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 393/783] 10.222.0.23 () {56 vars in 1115 bytes} [Fri Oct 21 21:09:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:14.737255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb564ea-0d81-4925-85c8-611da08ff84f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:14.738544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 391/784] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:09:14.828462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:14.840128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb564ea-0d81-4925-85c8-611da08ff84f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:14.873643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36263a2-e394-4654-8b3a-23828933369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:14.874270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36263a2-e394-4654-8b3a-23828933369b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:14.874548 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36263a2-e394-4654-8b3a-23828933369b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:14.874821 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36263a2-e394-4654-8b3a-23828933369b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:14.885896 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36263a2-e394-4654-8b3a-23828933369b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:14.887341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36263a2-e394-4654-8b3a-23828933369b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-a36263a2-e394-4654-8b3a-23828933369b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:09:14.901956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:14.902881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:09:14.908744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:09:14.908744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:14.908744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:14.908744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 394/785] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:09:14.910493 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6334ff-9a30-492a-8814-36431c695e4f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:14.982132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:15.005788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36263a2-e394-4654-8b3a-23828933369b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.017610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6334ff-9a30-492a-8814-36431c695e4f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.056874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b511daa-792c-41ff-893e-2ee267e0a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.057510 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b511daa-792c-41ff-893e-2ee267e0a146 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.057790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b511daa-792c-41ff-893e-2ee267e0a146 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.058066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b511daa-792c-41ff-893e-2ee267e0a146 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.058715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b511daa-792c-41ff-893e-2ee267e0a146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:15.059020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b511daa-792c-41ff-893e-2ee267e0a146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.060418 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b511daa-792c-41ff-893e-2ee267e0a146 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.072678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 392/786] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:15.074102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3870-8290-4e26-ab89-25e9c27d3c01 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.074390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3870-8290-4e26-ab89-25e9c27d3c01 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.074669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3870-8290-4e26-ab89-25e9c27d3c01 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.075912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 393/787] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:15.078462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3870-8290-4e26-ab89-25e9c27d3c01 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.115128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36263a2-e394-4654-8b3a-23828933369b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.148309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b9ee-40a8-490e-95b9-7f4e4993443f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.148932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b9ee-40a8-490e-95b9-7f4e4993443f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.149211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b9ee-40a8-490e-95b9-7f4e4993443f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.149482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b9ee-40a8-490e-95b9-7f4e4993443f None admin] PATH_INFO: `/v3/services/image` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.150056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8b9ee-40a8-490e-95b9-7f4e4993443f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.151449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8b9ee-40a8-490e-95b9-7f4e4993443f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-eca8b9ee-40a8-490e-95b9-7f4e4993443f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:15.160675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:15.161671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:15.162516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 395/788] 10.222.0.23 () {56 vars in 1105 bytes} [Fri Oct 21 21:09:15 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:09:15.163334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ddb6-1f46-4954-907c-f01285ed7848 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.163334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ddb6-1f46-4954-907c-f01285ed7848 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.164010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ddb6-1f46-4954-907c-f01285ed7848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.176570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:15.182227 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e2c1ddb6-1f46-4954-907c-f01285ed7848 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:15.182385 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3870-8290-4e26-ab89-25e9c27d3c01 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.183432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e2c1ddb6-1f46-4954-907c-f01285ed7848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:15.208736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:15.216987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f7006-0545-4861-8d79-a412df9874bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.217616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f7006-0545-4861-8d79-a412df9874bf None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.217899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f7006-0545-4861-8d79-a412df9874bf None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.218176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f7006-0545-4861-8d79-a412df9874bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.226113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f7006-0545-4861-8d79-a412df9874bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.227552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f7006-0545-4861-8d79-a412df9874bf None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-3c1f7006-0545-4861-8d79-a412df9874bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:09:15.238617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:15.239656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 394/789] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 21 21:09:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:09:15.240600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f7006-0545-4861-8d79-a412df9874bf None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.252074 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 396/790] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:15.252935 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1ddb6-1f46-4954-907c-f01285ed7848 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.343496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f7006-0545-4861-8d79-a412df9874bf None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.362630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1ddb6-1f46-4954-907c-f01285ed7848 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.378620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c946-eee1-41da-960e-81fe617ecfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.379517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c946-eee1-41da-960e-81fe617ecfec None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.379800 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c946-eee1-41da-960e-81fe617ecfec None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.380216 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c946-eee1-41da-960e-81fe617ecfec None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.380850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c946-eee1-41da-960e-81fe617ecfec None admin] RBAC: Adding query filter params (name=image) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:15.381425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c946-eee1-41da-960e-81fe617ecfec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.382785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c946-eee1-41da-960e-81fe617ecfec None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.388457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 395/791] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:15.394429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c946-eee1-41da-960e-81fe617ecfec None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.399926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94839df2-bab7-4872-908b-26afe066c028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.400544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94839df2-bab7-4872-908b-26afe066c028 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.400828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94839df2-bab7-4872-908b-26afe066c028 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.401105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94839df2-bab7-4872-908b-26afe066c028 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.401841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94839df2-bab7-4872-908b-26afe066c028 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:15.402145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94839df2-bab7-4872-908b-26afe066c028 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.404177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94839df2-bab7-4872-908b-26afe066c028 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.407661 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:15.425457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 397/792] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 21 21:09:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:15.431047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94839df2-bab7-4872-908b-26afe066c028 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.457687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:15.506584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c946-eee1-41da-960e-81fe617ecfec None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.533441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94839df2-bab7-4872-908b-26afe066c028 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.541338 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cab17-6ae6-439a-bb6d-d8b9d3f51d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.541946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cab17-6ae6-439a-bb6d-d8b9d3f51d6e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.542224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cab17-6ae6-439a-bb6d-d8b9d3f51d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.542498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cab17-6ae6-439a-bb6d-d8b9d3f51d6e None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.543121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cab17-6ae6-439a-bb6d-d8b9d3f51d6e None admin] RBAC: Adding query filter params (type=image) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:15.543454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cab17-6ae6-439a-bb6d-d8b9d3f51d6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.544834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cab17-6ae6-439a-bb6d-d8b9d3f51d6e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.550775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 396/793] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:15.552194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cab17-6ae6-439a-bb6d-d8b9d3f51d6e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.567913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac2e2b-1e8e-4641-9166-dbced4de3f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.568540 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac2e2b-1e8e-4641-9166-dbced4de3f71 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.568815 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac2e2b-1e8e-4641-9166-dbced4de3f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.569084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac2e2b-1e8e-4641-9166-dbced4de3f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.579011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac2e2b-1e8e-4641-9166-dbced4de3f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.581027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac2e2b-1e8e-4641-9166-dbced4de3f71 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-a9ac2e2b-1e8e-4641-9166-dbced4de3f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:09:15.595226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:15.596198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:09:15.597090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:09:15.597090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:15.597090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:15.597090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 398/794] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:09:15.597090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac2e2b-1e8e-4641-9166-dbced4de3f71 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.646470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:15.656266 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cab17-6ae6-439a-bb6d-d8b9d3f51d6e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.671729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:15.690001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc702cee-7ae2-4485-974f-aa8a37fa18d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.690561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc702cee-7ae2-4485-974f-aa8a37fa18d7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.690839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc702cee-7ae2-4485-974f-aa8a37fa18d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.691109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc702cee-7ae2-4485-974f-aa8a37fa18d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.692238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc702cee-7ae2-4485-974f-aa8a37fa18d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.693691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc702cee-7ae2-4485-974f-aa8a37fa18d7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.695257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 397/795] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:15.696031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc702cee-7ae2-4485-974f-aa8a37fa18d7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.702839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac2e2b-1e8e-4641-9166-dbced4de3f71 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.737218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61091c-d9c2-4c8a-9baf-8a6bf0460b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.737822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61091c-d9c2-4c8a-9baf-8a6bf0460b52 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.738170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61091c-d9c2-4c8a-9baf-8a6bf0460b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.738495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61091c-d9c2-4c8a-9baf-8a6bf0460b52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.739157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61091c-d9c2-4c8a-9baf-8a6bf0460b52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.740615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61091c-d9c2-4c8a-9baf-8a6bf0460b52 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.760422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 399/796] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:09:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:15.761128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61091c-d9c2-4c8a-9baf-8a6bf0460b52 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.801705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc702cee-7ae2-4485-974f-aa8a37fa18d7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.844383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265c73e-7a6e-49c0-8e52-d347b2c1b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.845004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c73e-7a6e-49c0-8e52-d347b2c1b830 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.845309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c73e-7a6e-49c0-8e52-d347b2c1b830 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.845579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c73e-7a6e-49c0-8e52-d347b2c1b830 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.846221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265c73e-7a6e-49c0-8e52-d347b2c1b830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:15.846521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265c73e-7a6e-49c0-8e52-d347b2c1b830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.847946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265c73e-7a6e-49c0-8e52-d347b2c1b830 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.865639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 398/797] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:15.866894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265c73e-7a6e-49c0-8e52-d347b2c1b830 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:15.884754 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61091c-d9c2-4c8a-9baf-8a6bf0460b52 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:15.886461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:15.915568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:15.924086 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc061b-0323-41c1-bfaa-63c0e092e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:15.924706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc061b-0323-41c1-bfaa-63c0e092e48a None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:15.924979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc061b-0323-41c1-bfaa-63c0e092e48a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:15.925250 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc061b-0323-41c1-bfaa-63c0e092e48a None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:15.925947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc061b-0323-41c1-bfaa-63c0e092e48a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:15.927859 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc061b-0323-41c1-bfaa-63c0e092e48a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:15.960409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 400/798] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:09:15 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:15.984630 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265c73e-7a6e-49c0-8e52-d347b2c1b830 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:16.025540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61f24f-ff7a-4fa7-b57e-a07c6ede8982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:16.026349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61f24f-ff7a-4fa7-b57e-a07c6ede8982 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:16.026722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61f24f-ff7a-4fa7-b57e-a07c6ede8982 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:16.027089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61f24f-ff7a-4fa7-b57e-a07c6ede8982 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:16.035134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61f24f-ff7a-4fa7-b57e-a07c6ede8982 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:16.036793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61f24f-ff7a-4fa7-b57e-a07c6ede8982 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-ff61f24f-ff7a-4fa7-b57e-a07c6ede8982 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:09:16.051188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:16.052303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:16.053381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:09:16.053381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:09:16.053381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:09:16.053381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:09:16.053381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:09:16.053381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:09:16.053381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:09:16.053381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:16.053381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 399/799] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:09:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:16.059840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc061b-0323-41c1-bfaa-63c0e092e48a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:16.168799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc061b-0323-41c1-bfaa-63c0e092e48a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:16.206695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a59e9-ef27-47db-b64f-d10f9500bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:16.207350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a59e9-ef27-47db-b64f-d10f9500bf23 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:16.207636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a59e9-ef27-47db-b64f-d10f9500bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:16.207914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a59e9-ef27-47db-b64f-d10f9500bf23 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:16.208616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a59e9-ef27-47db-b64f-d10f9500bf23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:16.208924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a59e9-ef27-47db-b64f-d10f9500bf23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:16.210360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a59e9-ef27-47db-b64f-d10f9500bf23 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:16.222784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 401/800] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:09:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:16.228923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61f24f-ff7a-4fa7-b57e-a07c6ede8982 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:16.328719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:16.332659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61f24f-ff7a-4fa7-b57e-a07c6ede8982 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:16.368842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73dce0-800e-457c-95b4-3e6e12594909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:16.369504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73dce0-800e-457c-95b4-3e6e12594909 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:16.369784 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73dce0-800e-457c-95b4-3e6e12594909 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:16.370056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73dce0-800e-457c-95b4-3e6e12594909 None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/8afe54a4c63b4a50a6240293e2be6450/roles/aee2782258cd4ca6b1171d38e9c05add` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:16.372208 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73dce0-800e-457c-95b4-3e6e12594909 None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=8afe54a4c63b4a50a6240293e2be6450, role_id=aee2782258cd4ca6b1171d38e9c05add)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:16.373643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73dce0-800e-457c-95b4-3e6e12594909 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:16.387713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 400/801] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:09:16 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/8afe54a4c63b4a50a6240293e2be6450/roles/aee2782258cd4ca6b1171d38e9c05add => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:09:17.951101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201be3a1-3a4c-490a-9f60-19877823dd39 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:17.951660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201be3a1-3a4c-490a-9f60-19877823dd39 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:17.951660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201be3a1-3a4c-490a-9f60-19877823dd39 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:17.953159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 402/802] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:17.958330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a08a-82be-4efe-82fe-1b3a1b4652c4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:17.958745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a08a-82be-4efe-82fe-1b3a1b4652c4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:17.958963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a08a-82be-4efe-82fe-1b3a1b4652c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:17.977867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5e80a08a-82be-4efe-82fe-1b3a1b4652c4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:17.979042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5e80a08a-82be-4efe-82fe-1b3a1b4652c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:18.059532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 401/803] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:18.148703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba585b-ad1b-4287-838a-7e40ebd34c0e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:18.148995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba585b-ad1b-4287-838a-7e40ebd34c0e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:18.149248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba585b-ad1b-4287-838a-7e40ebd34c0e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:18.150729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 403/804] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:18.155698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bed84-5ffe-42ec-89aa-f5530a330c88 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:18.155988 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bed84-5ffe-42ec-89aa-f5530a330c88 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:18.156263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bed84-5ffe-42ec-89aa-f5530a330c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:18.175809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-578bed84-5ffe-42ec-89aa-f5530a330c88 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:18.176977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-578bed84-5ffe-42ec-89aa-f5530a330c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:18.243350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 402/805] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:18.325931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba585b-ad1b-4287-838a-7e40ebd34c0e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:18.342356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:18.436726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba585b-ad1b-4287-838a-7e40ebd34c0e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:18.472535 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbac64-2eb4-4a93-bd98-78738089141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:18.473142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbac64-2eb4-4a93-bd98-78738089141f None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:18.473418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbac64-2eb4-4a93-bd98-78738089141f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:18.473688 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbac64-2eb4-4a93-bd98-78738089141f None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:18.474345 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbac64-2eb4-4a93-bd98-78738089141f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:18.475716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbac64-2eb4-4a93-bd98-78738089141f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:18.483328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.sql.core [None req-59fbac64-2eb4-4a93-bd98-78738089141f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 21 21:09:18.483328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 21 21:09:18.483328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [parameters: {'id': 'b85f4d142d07404a8c20e5b8f77b2ddc', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 21 21:09:18.483328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81348) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-59fbac64-2eb4-4a93-bd98-78738089141f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 21 21:09:18.491012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 21 21:09:18.491959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application yield resource Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.rollback() Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.force_reraise() Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise self.value Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application session.commit() Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 21 21:09:18.492986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._prepare_impl() Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.flush() Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._flush(objects) Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application compat.raise_( Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application flush_context.execute() Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rec.execute(self) Oct 21 21:09:18.493919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 21 21:09:18.494864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 21 21:09:18.497252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [parameters: {'id': 'b85f4d142d07404a8c20e5b8f77b2ddc', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 21 21:09:18.499376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:18.501327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:18.503588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 404/806] 10.222.0.23 () {60 vars in 1137 bytes} [Fri Oct 21 21:09:18 2022] POST /identity/v3/domains => generated 190 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:09:18.505339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bed84-5ffe-42ec-89aa-f5530a330c88 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:18.509954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbac64-2eb4-4a93-bd98-78738089141f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:18.527076 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:18.591733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:18.608546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bed84-5ffe-42ec-89aa-f5530a330c88 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:18.614457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbac64-2eb4-4a93-bd98-78738089141f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:18.641505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47903ce7-e373-45b6-9851-91023367734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:18.642210 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47903ce7-e373-45b6-9851-91023367734f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:18.642485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47903ce7-e373-45b6-9851-91023367734f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:18.642752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47903ce7-e373-45b6-9851-91023367734f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:18.646732 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6c9f0-bca4-44fe-8229-a356f8f17493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:18.647383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6c9f0-bca4-44fe-8229-a356f8f17493 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:18.647666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6c9f0-bca4-44fe-8229-a356f8f17493 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:18.647940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6c9f0-bca4-44fe-8229-a356f8f17493 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:18.649050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6c9f0-bca4-44fe-8229-a356f8f17493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:18.650474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6c9f0-bca4-44fe-8229-a356f8f17493 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:18.652071 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 405/807] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:18.652875 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47903ce7-e373-45b6-9851-91023367734f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:18.653195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7980-85fc-4475-8b7d-8a00efca2958 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:18.653478 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7980-85fc-4475-8b7d-8a00efca2958 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:18.653752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7980-85fc-4475-8b7d-8a00efca2958 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:18.654937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 406/808] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:18.655244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47903ce7-e373-45b6-9851-91023367734f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:18.660121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf7980-85fc-4475-8b7d-8a00efca2958 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-47903ce7-e373-45b6-9851-91023367734f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:09:18.670923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:18.671976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:09:18.672977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:09:18.672977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:18.672977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:18.672977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 403/809] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:18.676514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba8adf-2025-42f2-9786-a7eaed92d8e4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:18.676844 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba8adf-2025-42f2-9786-a7eaed92d8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:18.677126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba8adf-2025-42f2-9786-a7eaed92d8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:18.694192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-73ba8adf-2025-42f2-9786-a7eaed92d8e4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:18.695435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-73ba8adf-2025-42f2-9786-a7eaed92d8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:18.762641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 404/810] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:18.763441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba8adf-2025-42f2-9786-a7eaed92d8e4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:18.764644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf7980-85fc-4475-8b7d-8a00efca2958 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:18.765591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:18.801771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a103e1-86a6-4439-9c81-f5b83db64357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:18.802776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a103e1-86a6-4439-9c81-f5b83db64357 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:18.802776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a103e1-86a6-4439-9c81-f5b83db64357 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:18.802993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a103e1-86a6-4439-9c81-f5b83db64357 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:18.803576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a103e1-86a6-4439-9c81-f5b83db64357 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:18.804994 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a103e1-86a6-4439-9c81-f5b83db64357 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:18.843295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 407/811] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:09:18 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:18.874071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba8adf-2025-42f2-9786-a7eaed92d8e4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:18.911997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee2077-08dc-4168-b686-dba9beb37225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:18.912628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee2077-08dc-4168-b686-dba9beb37225 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:18.912912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee2077-08dc-4168-b686-dba9beb37225 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:18.913187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee2077-08dc-4168-b686-dba9beb37225 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:18.913849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee2077-08dc-4168-b686-dba9beb37225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:18.914156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee2077-08dc-4168-b686-dba9beb37225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:18.915571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee2077-08dc-4168-b686-dba9beb37225 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:18.928657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 405/812] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:19.038086 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a103e1-86a6-4439-9c81-f5b83db64357 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:19.041123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:19.153384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a103e1-86a6-4439-9c81-f5b83db64357 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:19.189966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc12468-8162-406b-b7aa-74b7e2ede889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:19.190598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc12468-8162-406b-b7aa-74b7e2ede889 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:19.190877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc12468-8162-406b-b7aa-74b7e2ede889 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:19.191150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc12468-8162-406b-b7aa-74b7e2ede889 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:19.202084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc12468-8162-406b-b7aa-74b7e2ede889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-bdc12468-8162-406b-b7aa-74b7e2ede889 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:09:19.207798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:19.208755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:19.209704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 408/813] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Oct 21 21:09:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:19.215055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee2077-08dc-4168-b686-dba9beb37225 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:19.281615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:19.320355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee2077-08dc-4168-b686-dba9beb37225 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:19.353011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463412a-64a4-4778-a200-dfc9262b8d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:19.353606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463412a-64a4-4778-a200-dfc9262b8d8b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:19.353880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463412a-64a4-4778-a200-dfc9262b8d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:19.354147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463412a-64a4-4778-a200-dfc9262b8d8b None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:19.354823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463412a-64a4-4778-a200-dfc9262b8d8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:19.355120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463412a-64a4-4778-a200-dfc9262b8d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:19.356584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463412a-64a4-4778-a200-dfc9262b8d8b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:19.365831 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 406/814] 10.222.0.23 () {56 vars in 1115 bytes} [Fri Oct 21 21:09:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:19.372115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc12468-8162-406b-b7aa-74b7e2ede889 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:19.431081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:19.468830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc12468-8162-406b-b7aa-74b7e2ede889 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:19.502443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337a909-bca4-4361-ae2d-617902e87288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:19.503057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337a909-bca4-4361-ae2d-617902e87288 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:19.503358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337a909-bca4-4361-ae2d-617902e87288 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:19.503633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337a909-bca4-4361-ae2d-617902e87288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:19.513321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337a909-bca4-4361-ae2d-617902e87288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:19.514741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337a909-bca4-4361-ae2d-617902e87288 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-f337a909-bca4-4361-ae2d-617902e87288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:09:19.530070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:19.531056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:09:19.532116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:09:19.532116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:19.532116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:19.532116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 409/815] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:19.537568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463412a-64a4-4778-a200-dfc9262b8d8b None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:19.635837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463412a-64a4-4778-a200-dfc9262b8d8b None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:19.659110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:19.669838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766f1fb-3c3f-46e3-a241-068f7600179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:19.670448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766f1fb-3c3f-46e3-a241-068f7600179f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:19.670728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766f1fb-3c3f-46e3-a241-068f7600179f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:19.670999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766f1fb-3c3f-46e3-a241-068f7600179f None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:19.671669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766f1fb-3c3f-46e3-a241-068f7600179f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:19.671974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766f1fb-3c3f-46e3-a241-068f7600179f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:19.673384 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766f1fb-3c3f-46e3-a241-068f7600179f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:19.684315 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 407/816] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:19.690054 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337a909-bca4-4361-ae2d-617902e87288 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:19.790657 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337a909-bca4-4361-ae2d-617902e87288 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:19.803610 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:19.823263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71dd5b-fbab-4ff9-9a00-ece9aff9821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:19.824161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71dd5b-fbab-4ff9-9a00-ece9aff9821f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:19.824435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71dd5b-fbab-4ff9-9a00-ece9aff9821f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:19.824704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71dd5b-fbab-4ff9-9a00-ece9aff9821f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:19.832355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71dd5b-fbab-4ff9-9a00-ece9aff9821f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:19.833778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71dd5b-fbab-4ff9-9a00-ece9aff9821f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-cc71dd5b-fbab-4ff9-9a00-ece9aff9821f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:09:19.844426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:19.845952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:19.846926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 410/817] 10.222.0.23 () {56 vars in 1093 bytes} [Fri Oct 21 21:09:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:09:19.851938 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766f1fb-3c3f-46e3-a241-068f7600179f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:19.951657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766f1fb-3c3f-46e3-a241-068f7600179f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:19.984341 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9caf-2240-4baf-a000-4f88b281b791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:19.984946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9caf-2240-4baf-a000-4f88b281b791 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:19.985227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9caf-2240-4baf-a000-4f88b281b791 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:19.985505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9caf-2240-4baf-a000-4f88b281b791 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:19.986265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9caf-2240-4baf-a000-4f88b281b791 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:19.986571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9caf-2240-4baf-a000-4f88b281b791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:19.988011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9caf-2240-4baf-a000-4f88b281b791 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:20.005186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 408/818] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Oct 21 21:09:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:20.010834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71dd5b-fbab-4ff9-9a00-ece9aff9821f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:20.111431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71dd5b-fbab-4ff9-9a00-ece9aff9821f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:20.144439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b87cc-7de8-4c2b-84db-a93c80952dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:20.145036 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b87cc-7de8-4c2b-84db-a93c80952dcb None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:20.145312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b87cc-7de8-4c2b-84db-a93c80952dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:20.145577 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b87cc-7de8-4c2b-84db-a93c80952dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:20.185622 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:20.211537 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b87cc-7de8-4c2b-84db-a93c80952dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:20.212899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b87cc-7de8-4c2b-84db-a93c80952dcb None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:20.305729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 411/819] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:09:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 21 21:09:20.311526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9caf-2240-4baf-a000-4f88b281b791 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:20.353120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:20.407326 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9caf-2240-4baf-a000-4f88b281b791 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:20.440539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135085-0b51-41fd-8ac3-1adbe4991fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:20.441158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135085-0b51-41fd-8ac3-1adbe4991fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:20.441432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135085-0b51-41fd-8ac3-1adbe4991fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:20.441699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135085-0b51-41fd-8ac3-1adbe4991fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:20.451579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78135085-0b51-41fd-8ac3-1adbe4991fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:20.453005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78135085-0b51-41fd-8ac3-1adbe4991fc3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-78135085-0b51-41fd-8ac3-1adbe4991fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:09:20.466971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:20.467925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:09:20.469336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:09:20.469336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:09:20.469336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:20.469336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 409/820] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:20.473679 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b87cc-7de8-4c2b-84db-a93c80952dcb None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:20.545158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:20.571104 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b87cc-7de8-4c2b-84db-a93c80952dcb None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:20.604588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478378b1-ea02-42f4-9da4-2e98324d908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:20.605195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478378b1-ea02-42f4-9da4-2e98324d908c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:20.605473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478378b1-ea02-42f4-9da4-2e98324d908c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:20.605746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478378b1-ea02-42f4-9da4-2e98324d908c None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:20.606382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478378b1-ea02-42f4-9da4-2e98324d908c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:20.606682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478378b1-ea02-42f4-9da4-2e98324d908c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:20.608075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478378b1-ea02-42f4-9da4-2e98324d908c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:20.619697 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 412/821] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:20.625313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135085-0b51-41fd-8ac3-1adbe4991fc3 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:20.716195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:20.724204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135085-0b51-41fd-8ac3-1adbe4991fc3 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:20.757602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03d14-fc86-4f8c-9fdb-3e64496300fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:20.758224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03d14-fc86-4f8c-9fdb-3e64496300fb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:20.758500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03d14-fc86-4f8c-9fdb-3e64496300fb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:20.758767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03d14-fc86-4f8c-9fdb-3e64496300fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:20.765429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b03d14-fc86-4f8c-9fdb-3e64496300fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:20.766854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b03d14-fc86-4f8c-9fdb-3e64496300fb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b0b03d14-fc86-4f8c-9fdb-3e64496300fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:09:20.777911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:20.779029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:20.780117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:09:20.780117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:09:20.780117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:09:20.780117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:09:20.780117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:09:20.780117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:09:20.780117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:09:20.780117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:20.783426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 410/822] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:09:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:20.785282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478378b1-ea02-42f4-9da4-2e98324d908c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:20.882180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478378b1-ea02-42f4-9da4-2e98324d908c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:20.914530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdfa9a-f1b9-4bd5-8381-a82c33dcd76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:20.915163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdfa9a-f1b9-4bd5-8381-a82c33dcd76e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:20.915472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdfa9a-f1b9-4bd5-8381-a82c33dcd76e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:20.915747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdfa9a-f1b9-4bd5-8381-a82c33dcd76e None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:20.916461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdfa9a-f1b9-4bd5-8381-a82c33dcd76e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:20.916766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdfa9a-f1b9-4bd5-8381-a82c33dcd76e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:20.918244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdfa9a-f1b9-4bd5-8381-a82c33dcd76e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:20.920176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:20.932787 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 413/823] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:20.939122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03d14-fc86-4f8c-9fdb-3e64496300fb None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:21.036475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0f7c7-d7b8-480d-960f-bed60de12b39 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:21.036683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0f7c7-d7b8-480d-960f-bed60de12b39 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:21.036931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0f7c7-d7b8-480d-960f-bed60de12b39 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:21.037519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03d14-fc86-4f8c-9fdb-3e64496300fb None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:21.038256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 414/824] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:09:21.043239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b462-d37f-40a6-a1ff-4fd7a29cd1b5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:21.043566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b462-d37f-40a6-a1ff-4fd7a29cd1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:21.043849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b462-d37f-40a6-a1ff-4fd7a29cd1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:21.066040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5152b462-d37f-40a6-a1ff-4fd7a29cd1b5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:21.067282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5152b462-d37f-40a6-a1ff-4fd7a29cd1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:21.070918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c32c6-ca99-4683-b570-8d6c3910efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:21.071543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c32c6-ca99-4683-b570-8d6c3910efbc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:21.071821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c32c6-ca99-4683-b570-8d6c3910efbc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:21.072092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c32c6-ca99-4683-b570-8d6c3910efbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:21.072811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c32c6-ca99-4683-b570-8d6c3910efbc None admin] RBAC: Adding query filter params (role.id=aee2782258cd4ca6b1171d38e9c05add, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=8afe54a4c63b4a50a6240293e2be6450) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:21.073117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c32c6-ca99-4683-b570-8d6c3910efbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:21.074804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c32c6-ca99-4683-b570-8d6c3910efbc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:21.080970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 411/825] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:09:20 2022] GET /identity/v3/role_assignments?user.id=8afe54a4c63b4a50a6240293e2be6450&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=aee2782258cd4ca6b1171d38e9c05add => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:21.137631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 415/826] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:09:21.405875 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c32c6-ca99-4683-b570-8d6c3910efbc None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:21.425520 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:21.508424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c32c6-ca99-4683-b570-8d6c3910efbc None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:21.542057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c8d00-2224-48e5-ba88-9d2cf7815598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:21.542687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c8d00-2224-48e5-ba88-9d2cf7815598 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:21.542963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c8d00-2224-48e5-ba88-9d2cf7815598 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:21.543228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c8d00-2224-48e5-ba88-9d2cf7815598 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:21.555031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c8d00-2224-48e5-ba88-9d2cf7815598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-786c8d00-2224-48e5-ba88-9d2cf7815598 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:09:21.559810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:21.560826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:21.561682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 412/827] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:09:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:21.567023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152b462-d37f-40a6-a1ff-4fd7a29cd1b5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:21.671837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152b462-d37f-40a6-a1ff-4fd7a29cd1b5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:21.695167 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:21.706905 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dc80e-d99e-4c97-9e05-6b2629b041c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:21.707550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dc80e-d99e-4c97-9e05-6b2629b041c8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:21.707832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dc80e-d99e-4c97-9e05-6b2629b041c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:21.708889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dc80e-d99e-4c97-9e05-6b2629b041c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:21.708889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dc80e-d99e-4c97-9e05-6b2629b041c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:21.709068 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dc80e-d99e-4c97-9e05-6b2629b041c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:21.710425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dc80e-d99e-4c97-9e05-6b2629b041c8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:21.718856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 416/828] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:09:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:21.725330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c8d00-2224-48e5-ba88-9d2cf7815598 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:21.806330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:21.830669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c8d00-2224-48e5-ba88-9d2cf7815598 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:21.864180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32070d78-afca-42f0-a97a-add043968dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:21.864815 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32070d78-afca-42f0-a97a-add043968dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:21.865097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32070d78-afca-42f0-a97a-add043968dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:21.865371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32070d78-afca-42f0-a97a-add043968dd6 None admin] PATH_INFO: `/v3/users/99fef329113444f0acfda03f566f360f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:21.878916 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32070d78-afca-42f0-a97a-add043968dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=99fef329113444f0acfda03f566f360f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:21.880371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32070d78-afca-42f0-a97a-add043968dd6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:21.882027 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 413/829] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:09:21 2022] GET /identity/v3/users/99fef329113444f0acfda03f566f360f => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:21.887984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dc80e-d99e-4c97-9e05-6b2629b041c8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:21.987229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dc80e-d99e-4c97-9e05-6b2629b041c8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:22.018751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0a0c6-da38-412c-9a07-6c848ef9a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:22.019391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0a0c6-da38-412c-9a07-6c848ef9a800 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:22.019769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0a0c6-da38-412c-9a07-6c848ef9a800 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:22.020040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0a0c6-da38-412c-9a07-6c848ef9a800 None admin] PATH_INFO: `/v3/projects/e2a85421a6284859bc17a8ba3ec5823c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:22.021158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0a0c6-da38-412c-9a07-6c848ef9a800 None admin] RBAC: Authorizing `identity:get_project(project_id=e2a85421a6284859bc17a8ba3ec5823c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:22.022561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0a0c6-da38-412c-9a07-6c848ef9a800 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:22.024194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 417/830] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:09:21 2022] GET /identity/v3/projects/e2a85421a6284859bc17a8ba3ec5823c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:22.030269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32070d78-afca-42f0-a97a-add043968dd6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:22.127523 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32070d78-afca-42f0-a97a-add043968dd6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:22.160096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0bab0-59c8-4230-97cc-9143e793749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:22.160737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0bab0-59c8-4230-97cc-9143e793749e None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:22.161009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0bab0-59c8-4230-97cc-9143e793749e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:22.161281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0bab0-59c8-4230-97cc-9143e793749e None admin] PATH_INFO: `/v3/projects/e2a85421a6284859bc17a8ba3ec5823c/users/99fef329113444f0acfda03f566f360f/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:22.163127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0bab0-59c8-4230-97cc-9143e793749e None admin] RBAC: Authorizing `identity:create_grant(project_id=e2a85421a6284859bc17a8ba3ec5823c, user_id=99fef329113444f0acfda03f566f360f, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:22.164558 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0bab0-59c8-4230-97cc-9143e793749e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:22.167465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:22.178802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 414/831] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:09:22 2022] PUT /identity/v3/projects/e2a85421a6284859bc17a8ba3ec5823c/users/99fef329113444f0acfda03f566f360f/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:09:24.259434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f04ec-6775-4870-9b1c-ba9d03fcc08a None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:24.259977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f04ec-6775-4870-9b1c-ba9d03fcc08a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:24.259977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f04ec-6775-4870-9b1c-ba9d03fcc08a None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:24.261349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 418/832] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:24.266373 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f28029-0b0a-421b-8774-e4096ba0ffc0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:24.266769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f28029-0b0a-421b-8774-e4096ba0ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:24.266898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f28029-0b0a-421b-8774-e4096ba0ffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:24.284559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b5f28029-0b0a-421b-8774-e4096ba0ffc0 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:24.285724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b5f28029-0b0a-421b-8774-e4096ba0ffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:24.349998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 415/833] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:24.619072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f04ec-6775-4870-9b1c-ba9d03fcc08a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:24.673827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:24.717455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f04ec-6775-4870-9b1c-ba9d03fcc08a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:24.751603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eafc12-ba3c-4f27-aaf9-6b3f2ac9c4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:24.752223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eafc12-ba3c-4f27-aaf9-6b3f2ac9c4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:24.752502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eafc12-ba3c-4f27-aaf9-6b3f2ac9c4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:24.752776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eafc12-ba3c-4f27-aaf9-6b3f2ac9c4c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:24.763019 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eafc12-ba3c-4f27-aaf9-6b3f2ac9c4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-99eafc12-ba3c-4f27-aaf9-6b3f2ac9c4c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:09:24.768245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:24.769356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:24.770628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 419/834] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:09:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:24.775259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f28029-0b0a-421b-8774-e4096ba0ffc0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:24.869807 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f28029-0b0a-421b-8774-e4096ba0ffc0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:24.895162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:24.904142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623aa4e-c560-4f6d-aa79-0ee5c7698d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:24.904737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623aa4e-c560-4f6d-aa79-0ee5c7698d11 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:24.905015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623aa4e-c560-4f6d-aa79-0ee5c7698d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:24.905293 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623aa4e-c560-4f6d-aa79-0ee5c7698d11 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:24.905944 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623aa4e-c560-4f6d-aa79-0ee5c7698d11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:24.906246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623aa4e-c560-4f6d-aa79-0ee5c7698d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:24.908193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623aa4e-c560-4f6d-aa79-0ee5c7698d11 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:24.915954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 416/835] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:09:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:24.921800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eafc12-ba3c-4f27-aaf9-6b3f2ac9c4c0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:25.019515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eafc12-ba3c-4f27-aaf9-6b3f2ac9c4c0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:25.032344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:25.053682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ce02a-bec9-421a-be79-b4567bb2c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:25.054302 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ce02a-bec9-421a-be79-b4567bb2c566 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:25.054577 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ce02a-bec9-421a-be79-b4567bb2c566 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:25.054846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ce02a-bec9-421a-be79-b4567bb2c566 None admin] PATH_INFO: `/v3/users/99fef329113444f0acfda03f566f360f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:25.055971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ce02a-bec9-421a-be79-b4567bb2c566 None admin] RBAC: Authorizing `identity:get_user(user_id=99fef329113444f0acfda03f566f360f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:25.057372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ce02a-bec9-421a-be79-b4567bb2c566 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:25.058926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 420/836] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:09:24 2022] GET /identity/v3/users/99fef329113444f0acfda03f566f360f => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:25.064878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623aa4e-c560-4f6d-aa79-0ee5c7698d11 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:25.162229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623aa4e-c560-4f6d-aa79-0ee5c7698d11 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:25.194642 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e1502-012a-4a94-a61f-ad1ca86f91ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:25.195235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1502-012a-4a94-a61f-ad1ca86f91ea None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:25.195548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1502-012a-4a94-a61f-ad1ca86f91ea None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:25.195824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1502-012a-4a94-a61f-ad1ca86f91ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:25.249166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:25.262232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e1502-012a-4a94-a61f-ad1ca86f91ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:25.263692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e1502-012a-4a94-a61f-ad1ca86f91ea None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:25.357538 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 417/837] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:09:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 21 21:09:25.363520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ce02a-bec9-421a-be79-b4567bb2c566 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:25.458284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ce02a-bec9-421a-be79-b4567bb2c566 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:25.489796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f762e6-36d5-4126-93f2-de35c0421b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:25.490400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f762e6-36d5-4126-93f2-de35c0421b2c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:25.490676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f762e6-36d5-4126-93f2-de35c0421b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:25.490953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f762e6-36d5-4126-93f2-de35c0421b2c None admin] PATH_INFO: `/v3/projects/e2a85421a6284859bc17a8ba3ec5823c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:25.492069 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f762e6-36d5-4126-93f2-de35c0421b2c None admin] RBAC: Authorizing `identity:get_project(project_id=e2a85421a6284859bc17a8ba3ec5823c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:25.493474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f762e6-36d5-4126-93f2-de35c0421b2c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:25.495039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 421/838] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:09:25 2022] GET /identity/v3/projects/e2a85421a6284859bc17a8ba3ec5823c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:25.500992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e1502-012a-4a94-a61f-ad1ca86f91ea None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:25.584920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:25.596893 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e1502-012a-4a94-a61f-ad1ca86f91ea None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:25.630408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06eee6-7cbd-47b3-bbf8-0211a18329c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:25.631003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06eee6-7cbd-47b3-bbf8-0211a18329c7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:25.631293 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06eee6-7cbd-47b3-bbf8-0211a18329c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:25.631579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06eee6-7cbd-47b3-bbf8-0211a18329c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:25.632295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06eee6-7cbd-47b3-bbf8-0211a18329c7 None admin] RBAC: Adding query filter params (role.id=58b61e8083c64fd58b3eb63efc4c7e3e, scope.project.id=e2a85421a6284859bc17a8ba3ec5823c, user.id=99fef329113444f0acfda03f566f360f) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:25.632599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06eee6-7cbd-47b3-bbf8-0211a18329c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:25.634009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06eee6-7cbd-47b3-bbf8-0211a18329c7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:25.639559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 418/839] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:09:25 2022] GET /identity/v3/role_assignments?user.id=99fef329113444f0acfda03f566f360f&scope.project.id=e2a85421a6284859bc17a8ba3ec5823c&role.id=58b61e8083c64fd58b3eb63efc4c7e3e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:27.740979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e0141-1c0f-46d8-9dc0-04192cf13b8a None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:27.741534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e0141-1c0f-46d8-9dc0-04192cf13b8a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:27.741534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e0141-1c0f-46d8-9dc0-04192cf13b8a None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:27.742850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 422/840] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:27.747998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c18e1-52e4-4181-ac39-43d5973b92bd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:27.748433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c18e1-52e4-4181-ac39-43d5973b92bd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:27.748560 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c18e1-52e4-4181-ac39-43d5973b92bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:27.766884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-591c18e1-52e4-4181-ac39-43d5973b92bd None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:27.768100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-591c18e1-52e4-4181-ac39-43d5973b92bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:27.832273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 419/841] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:28.103514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e0141-1c0f-46d8-9dc0-04192cf13b8a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:28.152645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:28.202252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e0141-1c0f-46d8-9dc0-04192cf13b8a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:28.234497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1320b-2337-40e8-8206-8d46d9284db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:28.235107 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1320b-2337-40e8-8206-8d46d9284db5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:28.235413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1320b-2337-40e8-8206-8d46d9284db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:28.235732 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1320b-2337-40e8-8206-8d46d9284db5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:28.236826 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1320b-2337-40e8-8206-8d46d9284db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:28.238231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1320b-2337-40e8-8206-8d46d9284db5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:28.239789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 423/842] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:28.245518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c18e1-52e4-4181-ac39-43d5973b92bd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:28.322330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:28.340496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c18e1-52e4-4181-ac39-43d5973b92bd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:28.371995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230d522-4c5a-492b-825a-854c6721a598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:28.372588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230d522-4c5a-492b-825a-854c6721a598 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:28.372865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230d522-4c5a-492b-825a-854c6721a598 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:28.373136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230d522-4c5a-492b-825a-854c6721a598 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:28.373770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230d522-4c5a-492b-825a-854c6721a598 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:28.375164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230d522-4c5a-492b-825a-854c6721a598 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:28.396937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 420/843] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:09:28 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:30.508599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805ae68-78ae-4f51-a26d-a4ec16444e19 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:30.509124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805ae68-78ae-4f51-a26d-a4ec16444e19 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:30.509231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805ae68-78ae-4f51-a26d-a4ec16444e19 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:30.510481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 424/844] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:30.515496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620595-0cda-4ee0-ac1a-80c966fff6ce None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:30.515933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620595-0cda-4ee0-ac1a-80c966fff6ce None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:30.516028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620595-0cda-4ee0-ac1a-80c966fff6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:30.534959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-96620595-0cda-4ee0-ac1a-80c966fff6ce None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:30.536161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-96620595-0cda-4ee0-ac1a-80c966fff6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:30.600465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 421/845] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:30.867974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805ae68-78ae-4f51-a26d-a4ec16444e19 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:30.966333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805ae68-78ae-4f51-a26d-a4ec16444e19 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:30.982314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:30.999254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f8e6f-40f9-45d6-ada9-80e9e7a15001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:30.999902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f8e6f-40f9-45d6-ada9-80e9e7a15001 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:31.000183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f8e6f-40f9-45d6-ada9-80e9e7a15001 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:31.000460 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f8e6f-40f9-45d6-ada9-80e9e7a15001 None admin] PATH_INFO: `/v3/roles/d742ebaf9dcb49d38c4758375c5ebd1f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:31.002401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f8e6f-40f9-45d6-ada9-80e9e7a15001 None admin] RBAC: Authorizing `identity:get_role(role_id=d742ebaf9dcb49d38c4758375c5ebd1f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:31.003793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f8e6f-40f9-45d6-ada9-80e9e7a15001 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:31.005098 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 425/846] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:09:30 2022] GET /identity/v3/roles/d742ebaf9dcb49d38c4758375c5ebd1f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:31.010899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96620595-0cda-4ee0-ac1a-80c966fff6ce None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:31.074814 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:31.107319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96620595-0cda-4ee0-ac1a-80c966fff6ce None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:31.140129 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5148af-ff7f-4786-8c95-780effb2c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:31.140696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5148af-ff7f-4786-8c95-780effb2c52a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:31.140973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5148af-ff7f-4786-8c95-780effb2c52a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:31.141245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5148af-ff7f-4786-8c95-780effb2c52a None admin] PATH_INFO: `/v3/users/59b2759c29a5463fb2655697d0b63ff7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:31.153587 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5148af-ff7f-4786-8c95-780effb2c52a None admin] RBAC: Authorizing `identity:get_user(user_id=59b2759c29a5463fb2655697d0b63ff7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:31.155029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5148af-ff7f-4786-8c95-780effb2c52a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:31.156637 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 422/847] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:09:31 2022] GET /identity/v3/users/59b2759c29a5463fb2655697d0b63ff7 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:31.163086 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f8e6f-40f9-45d6-ada9-80e9e7a15001 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:31.258175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f8e6f-40f9-45d6-ada9-80e9e7a15001 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:31.289808 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78098f69-1e12-4a75-9521-285b73b49388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:31.290416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78098f69-1e12-4a75-9521-285b73b49388 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:31.290691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78098f69-1e12-4a75-9521-285b73b49388 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:31.290963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78098f69-1e12-4a75-9521-285b73b49388 None admin] PATH_INFO: `/v3/projects/e2a85421a6284859bc17a8ba3ec5823c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:31.292081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78098f69-1e12-4a75-9521-285b73b49388 None admin] RBAC: Authorizing `identity:get_project(project_id=e2a85421a6284859bc17a8ba3ec5823c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:31.293482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78098f69-1e12-4a75-9521-285b73b49388 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:31.295046 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 426/848] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:09:31 2022] GET /identity/v3/projects/e2a85421a6284859bc17a8ba3ec5823c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:31.301406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5148af-ff7f-4786-8c95-780effb2c52a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:31.396477 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5148af-ff7f-4786-8c95-780effb2c52a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:31.421098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:31.430541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582b26-dadf-4dfd-99a2-241781f2656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:31.431182 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582b26-dadf-4dfd-99a2-241781f2656f None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:31.431491 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582b26-dadf-4dfd-99a2-241781f2656f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:31.431765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582b26-dadf-4dfd-99a2-241781f2656f None admin] PATH_INFO: `/v3/projects/e2a85421a6284859bc17a8ba3ec5823c/users/59b2759c29a5463fb2655697d0b63ff7/roles/d742ebaf9dcb49d38c4758375c5ebd1f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:31.433857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44582b26-dadf-4dfd-99a2-241781f2656f None admin] RBAC: Authorizing `identity:create_grant(project_id=e2a85421a6284859bc17a8ba3ec5823c, user_id=59b2759c29a5463fb2655697d0b63ff7, role_id=d742ebaf9dcb49d38c4758375c5ebd1f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:31.435290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44582b26-dadf-4dfd-99a2-241781f2656f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:31.447522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 423/849] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:09:31 2022] PUT /identity/v3/projects/e2a85421a6284859bc17a8ba3ec5823c/users/59b2759c29a5463fb2655697d0b63ff7/roles/d742ebaf9dcb49d38c4758375c5ebd1f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:09:33.558341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ebccc-f52b-4b30-8bab-951a175c9d0c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:33.558870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ebccc-f52b-4b30-8bab-951a175c9d0c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:33.558870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ebccc-f52b-4b30-8bab-951a175c9d0c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:33.560248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 427/850] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:09:33.565653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabab2a-730e-430e-8815-f08d5cd1c484 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:33.566030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabab2a-730e-430e-8815-f08d5cd1c484 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:33.566206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabab2a-730e-430e-8815-f08d5cd1c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:33.584099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7aabab2a-730e-430e-8815-f08d5cd1c484 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:33.585270 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7aabab2a-730e-430e-8815-f08d5cd1c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:33.648479 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 424/851] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:33.917368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ebccc-f52b-4b30-8bab-951a175c9d0c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:33.972921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:34.017381 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ebccc-f52b-4b30-8bab-951a175c9d0c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:34.049444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce357a-1657-45d6-9119-7318e119db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:34.050065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce357a-1657-45d6-9119-7318e119db11 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:34.050342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce357a-1657-45d6-9119-7318e119db11 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:34.050619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce357a-1657-45d6-9119-7318e119db11 None admin] PATH_INFO: `/v3/roles/d742ebaf9dcb49d38c4758375c5ebd1f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:34.052282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce357a-1657-45d6-9119-7318e119db11 None admin] RBAC: Authorizing `identity:get_role(role_id=d742ebaf9dcb49d38c4758375c5ebd1f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:34.053642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce357a-1657-45d6-9119-7318e119db11 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:34.055410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 428/852] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:09:33 2022] GET /identity/v3/roles/d742ebaf9dcb49d38c4758375c5ebd1f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:34.060827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabab2a-730e-430e-8815-f08d5cd1c484 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:34.157176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabab2a-730e-430e-8815-f08d5cd1c484 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:34.172789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:34.191178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ab102-c5f1-4c03-930f-d0fce4a162b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:34.191826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ab102-c5f1-4c03-930f-d0fce4a162b8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:34.192109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ab102-c5f1-4c03-930f-d0fce4a162b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:34.192392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ab102-c5f1-4c03-930f-d0fce4a162b8 None admin] PATH_INFO: `/v3/users/59b2759c29a5463fb2655697d0b63ff7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:34.193503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ab102-c5f1-4c03-930f-d0fce4a162b8 None admin] RBAC: Authorizing `identity:get_user(user_id=59b2759c29a5463fb2655697d0b63ff7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:34.194915 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ab102-c5f1-4c03-930f-d0fce4a162b8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:34.196533 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 425/853] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:09:34 2022] GET /identity/v3/users/59b2759c29a5463fb2655697d0b63ff7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:34.202482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce357a-1657-45d6-9119-7318e119db11 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:34.296813 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce357a-1657-45d6-9119-7318e119db11 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:34.317963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:34.330374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b15d5-cee2-4c8d-8ae2-56043d4f2ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:34.330959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b15d5-cee2-4c8d-8ae2-56043d4f2ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:34.331236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b15d5-cee2-4c8d-8ae2-56043d4f2ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:34.331533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b15d5-cee2-4c8d-8ae2-56043d4f2ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:34.394625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b15d5-cee2-4c8d-8ae2-56043d4f2ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:34.396060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b15d5-cee2-4c8d-8ae2-56043d4f2ad8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:34.488932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 429/854] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:09:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 21 21:09:34.494764 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ab102-c5f1-4c03-930f-d0fce4a162b8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:34.589912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ab102-c5f1-4c03-930f-d0fce4a162b8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:34.622812 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d232-de38-4f70-a75f-be601eec9e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:34.623448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d232-de38-4f70-a75f-be601eec9e31 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:34.623727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d232-de38-4f70-a75f-be601eec9e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:34.623996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d232-de38-4f70-a75f-be601eec9e31 None admin] PATH_INFO: `/v3/projects/e2a85421a6284859bc17a8ba3ec5823c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:34.625080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d232-de38-4f70-a75f-be601eec9e31 None admin] RBAC: Authorizing `identity:get_project(project_id=e2a85421a6284859bc17a8ba3ec5823c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:34.627059 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d232-de38-4f70-a75f-be601eec9e31 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:34.628663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 426/855] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:09:34 2022] GET /identity/v3/projects/e2a85421a6284859bc17a8ba3ec5823c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:34.634881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b15d5-cee2-4c8d-8ae2-56043d4f2ad8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:34.657352 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:34.730362 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b15d5-cee2-4c8d-8ae2-56043d4f2ad8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:34.763497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17314d-8a2e-45ce-a4f5-cf2e66af97e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:34.764028 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17314d-8a2e-45ce-a4f5-cf2e66af97e5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:34.764304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17314d-8a2e-45ce-a4f5-cf2e66af97e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:34.764575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17314d-8a2e-45ce-a4f5-cf2e66af97e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:34.765289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17314d-8a2e-45ce-a4f5-cf2e66af97e5 None admin] RBAC: Adding query filter params (role.id=d742ebaf9dcb49d38c4758375c5ebd1f, scope.project.id=e2a85421a6284859bc17a8ba3ec5823c, user.id=59b2759c29a5463fb2655697d0b63ff7) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:34.765594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17314d-8a2e-45ce-a4f5-cf2e66af97e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:34.766989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17314d-8a2e-45ce-a4f5-cf2e66af97e5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:34.772492 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 430/856] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:09:34 2022] GET /identity/v3/role_assignments?user.id=59b2759c29a5463fb2655697d0b63ff7&scope.project.id=e2a85421a6284859bc17a8ba3ec5823c&role.id=d742ebaf9dcb49d38c4758375c5ebd1f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:36.876529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659c4ac-d4c7-4d7a-9cf6-e05131850fb3 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:36.877048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659c4ac-d4c7-4d7a-9cf6-e05131850fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:36.877048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659c4ac-d4c7-4d7a-9cf6-e05131850fb3 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:36.879089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 427/857] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:36.884519 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5c72e-dd86-41d9-b8ce-51561ae5c614 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:36.884937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5c72e-dd86-41d9-b8ce-51561ae5c614 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:36.885065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5c72e-dd86-41d9-b8ce-51561ae5c614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:36.902632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4fa5c72e-dd86-41d9-b8ce-51561ae5c614 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:36.903837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4fa5c72e-dd86-41d9-b8ce-51561ae5c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:36.967851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 431/858] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:37.230009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659c4ac-d4c7-4d7a-9cf6-e05131850fb3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:37.396055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:37.443319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659c4ac-d4c7-4d7a-9cf6-e05131850fb3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:37.475929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6490cee-d9b6-4ca0-9795-af76878bb177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:37.476533 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6490cee-d9b6-4ca0-9795-af76878bb177 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:37.476808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6490cee-d9b6-4ca0-9795-af76878bb177 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:37.477075 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6490cee-d9b6-4ca0-9795-af76878bb177 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:37.478158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6490cee-d9b6-4ca0-9795-af76878bb177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:37.479598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6490cee-d9b6-4ca0-9795-af76878bb177 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:37.481180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 428/859] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:37.487742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5c72e-dd86-41d9-b8ce-51561ae5c614 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:37.504401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:37.583385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5c72e-dd86-41d9-b8ce-51561ae5c614 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:37.615423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb499c1-6148-454c-85e5-048e9df0a2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:37.616016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb499c1-6148-454c-85e5-048e9df0a2bb None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:37.616290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb499c1-6148-454c-85e5-048e9df0a2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:37.616558 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb499c1-6148-454c-85e5-048e9df0a2bb None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:37.617190 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb499c1-6148-454c-85e5-048e9df0a2bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:37.618584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb499c1-6148-454c-85e5-048e9df0a2bb None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:37.643826 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 432/860] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:09:37 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:39.788333 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41e97-6bc1-4355-8bb9-dd15a435df99 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:39.788865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41e97-6bc1-4355-8bb9-dd15a435df99 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:39.788865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41e97-6bc1-4355-8bb9-dd15a435df99 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:39.790199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 429/861] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:39.795347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c1e5-472d-4bf1-a020-653c32f4d19a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:39.795715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c1e5-472d-4bf1-a020-653c32f4d19a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:39.795899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c1e5-472d-4bf1-a020-653c32f4d19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:39.813810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8440c1e5-472d-4bf1-a020-653c32f4d19a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:39.814991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8440c1e5-472d-4bf1-a020-653c32f4d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:39.874140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:39.879662 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 433/862] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:40.145225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db41e97-6bc1-4355-8bb9-dd15a435df99 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:40.242371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db41e97-6bc1-4355-8bb9-dd15a435df99 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:40.261839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:40.275965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6325dbb-0b36-43d8-a912-9e16b52663c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:40.276578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6325dbb-0b36-43d8-a912-9e16b52663c5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:40.276854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6325dbb-0b36-43d8-a912-9e16b52663c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:40.277126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6325dbb-0b36-43d8-a912-9e16b52663c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:40.278214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6325dbb-0b36-43d8-a912-9e16b52663c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:40.279654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6325dbb-0b36-43d8-a912-9e16b52663c5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:40.281228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 430/863] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:09:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:40.286805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c1e5-472d-4bf1-a020-653c32f4d19a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:40.382484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c1e5-472d-4bf1-a020-653c32f4d19a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:40.414763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c803f8-9422-4474-97f6-c803b5cc8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:40.415383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c803f8-9422-4474-97f6-c803b5cc8af9 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:40.415663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c803f8-9422-4474-97f6-c803b5cc8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:40.415937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c803f8-9422-4474-97f6-c803b5cc8af9 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:40.416595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c803f8-9422-4474-97f6-c803b5cc8af9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:40.417995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c803f8-9422-4474-97f6-c803b5cc8af9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:40.437542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 434/864] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:09:40 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:42.670423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387285b-b729-42ec-860f-84c5af8ca322 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:42.670977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387285b-b729-42ec-860f-84c5af8ca322 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:42.670977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387285b-b729-42ec-860f-84c5af8ca322 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:42.672325 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 431/865] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:42.677974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d4651-712a-4d33-97a0-cbc9b22ddd67 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:42.678376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d4651-712a-4d33-97a0-cbc9b22ddd67 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:42.678526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d4651-712a-4d33-97a0-cbc9b22ddd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:42.696830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7a0d4651-712a-4d33-97a0-cbc9b22ddd67 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:42.698016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7a0d4651-712a-4d33-97a0-cbc9b22ddd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:42.745484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:42.764374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 435/866] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:09:43.031967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387285b-b729-42ec-860f-84c5af8ca322 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:43.130009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387285b-b729-42ec-860f-84c5af8ca322 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:43.162356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc6da-eb1b-400a-bb56-b111eaa2ccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:43.162972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc6da-eb1b-400a-bb56-b111eaa2ccc4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:43.163250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc6da-eb1b-400a-bb56-b111eaa2ccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:43.163555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc6da-eb1b-400a-bb56-b111eaa2ccc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:43.173371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fc6da-eb1b-400a-bb56-b111eaa2ccc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-2d7fc6da-eb1b-400a-bb56-b111eaa2ccc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:09:43.178168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:43.179226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:43.180396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 432/867] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:09:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:43.185185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d4651-712a-4d33-97a0-cbc9b22ddd67 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:43.281389 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d4651-712a-4d33-97a0-cbc9b22ddd67 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:43.314348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acd871-1f58-4424-aa53-247921d67ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:43.314889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd871-1f58-4424-aa53-247921d67ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:43.315165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd871-1f58-4424-aa53-247921d67ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:43.315464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd871-1f58-4424-aa53-247921d67ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:43.316134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acd871-1f58-4424-aa53-247921d67ae4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:43.316440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acd871-1f58-4424-aa53-247921d67ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:43.317782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acd871-1f58-4424-aa53-247921d67ae4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:43.325678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 436/868] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:09:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:43.331827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc6da-eb1b-400a-bb56-b111eaa2ccc4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:43.379449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:43.428512 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc6da-eb1b-400a-bb56-b111eaa2ccc4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:43.461557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11165db2-c88e-4961-9441-802198e3dd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:43.462163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11165db2-c88e-4961-9441-802198e3dd2b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:43.462445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11165db2-c88e-4961-9441-802198e3dd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:43.462721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11165db2-c88e-4961-9441-802198e3dd2b None admin] PATH_INFO: `/v3/users/e49a73d69b084fffa4a016b97e95c9ab` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:43.475249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11165db2-c88e-4961-9441-802198e3dd2b None admin] RBAC: Authorizing `identity:get_user(user_id=e49a73d69b084fffa4a016b97e95c9ab)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:43.476698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11165db2-c88e-4961-9441-802198e3dd2b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:43.478257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 433/869] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:09:43 2022] GET /identity/v3/users/e49a73d69b084fffa4a016b97e95c9ab => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:43.483880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acd871-1f58-4424-aa53-247921d67ae4 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:43.528683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:43.579850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acd871-1f58-4424-aa53-247921d67ae4 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:43.612065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c2ee7-afcd-4bfe-ac84-1f982140c2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:43.612680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c2ee7-afcd-4bfe-ac84-1f982140c2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:43.612954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c2ee7-afcd-4bfe-ac84-1f982140c2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:43.613222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c2ee7-afcd-4bfe-ac84-1f982140c2f9 None admin] PATH_INFO: `/v3/projects/aa3b11d108c44207a4bd37b7c69d9e62` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:43.614303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c2ee7-afcd-4bfe-ac84-1f982140c2f9 None admin] RBAC: Authorizing `identity:get_project(project_id=aa3b11d108c44207a4bd37b7c69d9e62)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:43.615733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c2ee7-afcd-4bfe-ac84-1f982140c2f9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:43.617310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 437/870] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:09:43 2022] GET /identity/v3/projects/aa3b11d108c44207a4bd37b7c69d9e62 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:43.623055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11165db2-c88e-4961-9441-802198e3dd2b None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:43.717840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11165db2-c88e-4961-9441-802198e3dd2b None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:43.726016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:43.752400 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436e8c3-d535-4b7e-af56-1003e7ecb9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:43.753037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e8c3-d535-4b7e-af56-1003e7ecb9e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:43.753316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e8c3-d535-4b7e-af56-1003e7ecb9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:43.753585 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e8c3-d535-4b7e-af56-1003e7ecb9e8 None admin] PATH_INFO: `/v3/projects/aa3b11d108c44207a4bd37b7c69d9e62/users/e49a73d69b084fffa4a016b97e95c9ab/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:43.755452 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436e8c3-d535-4b7e-af56-1003e7ecb9e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa3b11d108c44207a4bd37b7c69d9e62, user_id=e49a73d69b084fffa4a016b97e95c9ab, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:43.756850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436e8c3-d535-4b7e-af56-1003e7ecb9e8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:43.768561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 434/871] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:09:43 2022] PUT /identity/v3/projects/aa3b11d108c44207a4bd37b7c69d9e62/users/e49a73d69b084fffa4a016b97e95c9ab/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:09:45.838084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8fc24-01b5-411c-a313-46ecddb69c9a None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:45.838608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8fc24-01b5-411c-a313-46ecddb69c9a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:45.838608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8fc24-01b5-411c-a313-46ecddb69c9a None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:45.839982 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 438/872] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:45.845600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92b15-b9cc-4c14-98f4-48f65ea64b15 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:45.845975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92b15-b9cc-4c14-98f4-48f65ea64b15 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:45.846131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92b15-b9cc-4c14-98f4-48f65ea64b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:45.864107 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0ca92b15-b9cc-4c14-98f4-48f65ea64b15 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:45.865260 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0ca92b15-b9cc-4c14-98f4-48f65ea64b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:45.928474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 435/873] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:46.194362 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8fc24-01b5-411c-a313-46ecddb69c9a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:46.292371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8fc24-01b5-411c-a313-46ecddb69c9a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:46.305204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:46.324861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac7337-a40d-4a97-8c1e-a60feba5a127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:46.325473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7337-a40d-4a97-8c1e-a60feba5a127 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:46.325747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7337-a40d-4a97-8c1e-a60feba5a127 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:46.326016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7337-a40d-4a97-8c1e-a60feba5a127 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:46.336648 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac7337-a40d-4a97-8c1e-a60feba5a127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-c6ac7337-a40d-4a97-8c1e-a60feba5a127 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:09:46.341350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:46.342427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:09:46.343520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 439/874] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:09:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:46.348854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca92b15-b9cc-4c14-98f4-48f65ea64b15 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:46.437136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:46.443622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca92b15-b9cc-4c14-98f4-48f65ea64b15 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:46.477166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb4f4e-aaae-4d37-b999-202f5c66c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:46.477705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb4f4e-aaae-4d37-b999-202f5c66c845 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:46.477978 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb4f4e-aaae-4d37-b999-202f5c66c845 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:46.478246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb4f4e-aaae-4d37-b999-202f5c66c845 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:46.478887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb4f4e-aaae-4d37-b999-202f5c66c845 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:46.479184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb4f4e-aaae-4d37-b999-202f5c66c845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:46.480619 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb4f4e-aaae-4d37-b999-202f5c66c845 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:46.488712 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 436/875] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:09:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:46.494295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac7337-a40d-4a97-8c1e-a60feba5a127 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:46.589868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac7337-a40d-4a97-8c1e-a60feba5a127 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:46.621593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a004-bc76-4d71-b2e3-f06b32eb1f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:46.622193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a004-bc76-4d71-b2e3-f06b32eb1f69 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:46.622469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a004-bc76-4d71-b2e3-f06b32eb1f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:46.622740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a004-bc76-4d71-b2e3-f06b32eb1f69 None admin] PATH_INFO: `/v3/users/e49a73d69b084fffa4a016b97e95c9ab` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:46.623850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a004-bc76-4d71-b2e3-f06b32eb1f69 None admin] RBAC: Authorizing `identity:get_user(user_id=e49a73d69b084fffa4a016b97e95c9ab)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:46.625250 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a004-bc76-4d71-b2e3-f06b32eb1f69 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:46.627310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 440/876] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:09:46 2022] GET /identity/v3/users/e49a73d69b084fffa4a016b97e95c9ab => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:46.632885 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb4f4e-aaae-4d37-b999-202f5c66c845 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:46.728499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb4f4e-aaae-4d37-b999-202f5c66c845 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:46.760907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde1e0b-a02a-41f9-9380-cb46d50f8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:46.761498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde1e0b-a02a-41f9-9380-cb46d50f8da5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:46.761776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde1e0b-a02a-41f9-9380-cb46d50f8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:46.762048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde1e0b-a02a-41f9-9380-cb46d50f8da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:46.787982 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:46.827759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde1e0b-a02a-41f9-9380-cb46d50f8da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:46.829800 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde1e0b-a02a-41f9-9380-cb46d50f8da5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:46.922782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 437/877] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:09:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 21 21:09:46.928689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a004-bc76-4d71-b2e3-f06b32eb1f69 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:47.084941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:47.138182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a004-bc76-4d71-b2e3-f06b32eb1f69 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:47.169551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4137f2-73da-4524-8f65-7fb36eba0448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:47.170161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4137f2-73da-4524-8f65-7fb36eba0448 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:47.170435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4137f2-73da-4524-8f65-7fb36eba0448 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:47.170703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4137f2-73da-4524-8f65-7fb36eba0448 None admin] PATH_INFO: `/v3/projects/aa3b11d108c44207a4bd37b7c69d9e62` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:47.171810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4137f2-73da-4524-8f65-7fb36eba0448 None admin] RBAC: Authorizing `identity:get_project(project_id=aa3b11d108c44207a4bd37b7c69d9e62)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:47.173756 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4137f2-73da-4524-8f65-7fb36eba0448 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:47.175359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 441/878] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:09:46 2022] GET /identity/v3/projects/aa3b11d108c44207a4bd37b7c69d9e62 => generated 311 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:47.181466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde1e0b-a02a-41f9-9380-cb46d50f8da5 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:47.236659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:47.276203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde1e0b-a02a-41f9-9380-cb46d50f8da5 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:47.308414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04009b-e799-480a-8844-79cc6a1c4427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:47.308942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04009b-e799-480a-8844-79cc6a1c4427 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:47.309214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04009b-e799-480a-8844-79cc6a1c4427 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:47.309481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04009b-e799-480a-8844-79cc6a1c4427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:47.310187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04009b-e799-480a-8844-79cc6a1c4427 None admin] RBAC: Adding query filter params (role.id=58b61e8083c64fd58b3eb63efc4c7e3e, scope.project.id=aa3b11d108c44207a4bd37b7c69d9e62, user.id=e49a73d69b084fffa4a016b97e95c9ab) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:47.310487 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04009b-e799-480a-8844-79cc6a1c4427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:47.311915 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04009b-e799-480a-8844-79cc6a1c4427 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:47.317451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 438/879] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:09:47 2022] GET /identity/v3/role_assignments?user.id=e49a73d69b084fffa4a016b97e95c9ab&scope.project.id=aa3b11d108c44207a4bd37b7c69d9e62&role.id=58b61e8083c64fd58b3eb63efc4c7e3e => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:49.415147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621800a-03d8-4d70-aa12-44d165c410cd None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:49.415720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621800a-03d8-4d70-aa12-44d165c410cd None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:49.415720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621800a-03d8-4d70-aa12-44d165c410cd None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:49.416960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 442/880] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:49.422155 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ef3f-8c2c-4505-bedf-c90c5b79ac93 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:49.422541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ef3f-8c2c-4505-bedf-c90c5b79ac93 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:49.422698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ef3f-8c2c-4505-bedf-c90c5b79ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:49.441860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c258ef3f-8c2c-4505-bedf-c90c5b79ac93 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:49.443014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c258ef3f-8c2c-4505-bedf-c90c5b79ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:49.506213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 439/881] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:49.770162 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621800a-03d8-4d70-aa12-44d165c410cd None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:49.868421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621800a-03d8-4d70-aa12-44d165c410cd None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:49.878475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:49.900693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453251-69d9-481b-a624-7a687959c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:49.901283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453251-69d9-481b-a624-7a687959c4f6 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:49.901563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453251-69d9-481b-a624-7a687959c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:49.901836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453251-69d9-481b-a624-7a687959c4f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:49.902503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51453251-69d9-481b-a624-7a687959c4f6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:49.903866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51453251-69d9-481b-a624-7a687959c4f6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:49.919151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 443/882] 10.222.0.23 () {60 vars in 1138 bytes} [Fri Oct 21 21:09:49 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:09:52.054101 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573994-241c-4616-9216-f878f13c14a3 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:52.054651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573994-241c-4616-9216-f878f13c14a3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:52.054651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27573994-241c-4616-9216-f878f13c14a3 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:52.056010 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 440/883] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:52.061240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd024c3-8ec1-4fa3-947b-602861dfbeae None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:52.061653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd024c3-8ec1-4fa3-947b-602861dfbeae None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:52.061784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd024c3-8ec1-4fa3-947b-602861dfbeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:52.079574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-dfd024c3-8ec1-4fa3-947b-602861dfbeae None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:52.080738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dfd024c3-8ec1-4fa3-947b-602861dfbeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:52.143158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 444/884] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:52.407004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27573994-241c-4616-9216-f878f13c14a3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:52.459432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:52.505120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27573994-241c-4616-9216-f878f13c14a3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:52.538308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb517b-6caf-4159-9db3-8d846270e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:52.538922 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb517b-6caf-4159-9db3-8d846270e5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:52.539200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb517b-6caf-4159-9db3-8d846270e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:52.539500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb517b-6caf-4159-9db3-8d846270e5a5 None admin] PATH_INFO: `/v3/domains/3a8e62e780854b6283358bf59ca2d1ca` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:52.549536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb517b-6caf-4159-9db3-8d846270e5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3a8e62e780854b6283358bf59ca2d1ca)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:52.550949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb517b-6caf-4159-9db3-8d846270e5a5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:52.552542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 441/885] 10.222.0.23 () {56 vars in 1183 bytes} [Fri Oct 21 21:09:52 2022] GET /identity/v3/domains/3a8e62e780854b6283358bf59ca2d1ca => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:52.558305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd024c3-8ec1-4fa3-947b-602861dfbeae None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:52.650604 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:52.653655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd024c3-8ec1-4fa3-947b-602861dfbeae None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:52.686654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc2be5-d99e-43dc-9ba3-bbd52de3481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:52.687244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2be5-d99e-43dc-9ba3-bbd52de3481a None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:52.687549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2be5-d99e-43dc-9ba3-bbd52de3481a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:52.687822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2be5-d99e-43dc-9ba3-bbd52de3481a None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:52.688454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc2be5-d99e-43dc-9ba3-bbd52de3481a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:52.690416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc2be5-d99e-43dc-9ba3-bbd52de3481a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:52.716927 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 445/886] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:09:52 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:09:54.847217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30ffe5-575b-423b-814b-9edc1d9e3ad0 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:54.847789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30ffe5-575b-423b-814b-9edc1d9e3ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:54.847789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30ffe5-575b-423b-814b-9edc1d9e3ad0 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:54.849143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 442/887] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:54.854516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9935df-20a5-4d42-bb04-b509820e0707 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:54.854923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9935df-20a5-4d42-bb04-b509820e0707 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:54.855056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9935df-20a5-4d42-bb04-b509820e0707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:54.873174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0a9935df-20a5-4d42-bb04-b509820e0707 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:54.874327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0a9935df-20a5-4d42-bb04-b509820e0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:54.937178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 446/888] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:09:55.201871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30ffe5-575b-423b-814b-9edc1d9e3ad0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:55.300706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30ffe5-575b-423b-814b-9edc1d9e3ad0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:55.312639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:55.333890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07f9da-eab9-433b-b701-e209fc9db014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:55.334508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07f9da-eab9-433b-b701-e209fc9db014 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:55.334788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07f9da-eab9-433b-b701-e209fc9db014 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:55.335062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07f9da-eab9-433b-b701-e209fc9db014 None admin] PATH_INFO: `/v3/domains/3a8e62e780854b6283358bf59ca2d1ca` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:55.336197 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07f9da-eab9-433b-b701-e209fc9db014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3a8e62e780854b6283358bf59ca2d1ca)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:55.337613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07f9da-eab9-433b-b701-e209fc9db014 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:55.339154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 443/889] 10.222.0.23 () {56 vars in 1183 bytes} [Fri Oct 21 21:09:55 2022] GET /identity/v3/domains/3a8e62e780854b6283358bf59ca2d1ca => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:55.344837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9935df-20a5-4d42-bb04-b509820e0707 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:55.421454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:55.440656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9935df-20a5-4d42-bb04-b509820e0707 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:55.473598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf87c8-64a5-4299-90ba-66c4109834c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:55.474132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf87c8-64a5-4299-90ba-66c4109834c6 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:55.474409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf87c8-64a5-4299-90ba-66c4109834c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:55.474677 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf87c8-64a5-4299-90ba-66c4109834c6 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:55.475346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf87c8-64a5-4299-90ba-66c4109834c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:55.476740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf87c8-64a5-4299-90ba-66c4109834c6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:55.497122 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 447/890] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:09:55 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:09:57.631859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab9b1-fccd-4aa0-9247-b09f813bf14e None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:57.632383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab9b1-fccd-4aa0-9247-b09f813bf14e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:57.632504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab9b1-fccd-4aa0-9247-b09f813bf14e None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:57.633756 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 444/891] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:09:57.639116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aba77-48b4-4d02-bf9a-583a91c21adf None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:57.639558 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aba77-48b4-4d02-bf9a-583a91c21adf None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:57.639696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aba77-48b4-4d02-bf9a-583a91c21adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:57.657258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-847aba77-48b4-4d02-bf9a-583a91c21adf None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:09:57.658408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-847aba77-48b4-4d02-bf9a-583a91c21adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:09:57.723474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 448/892] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:09:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:09:57.996174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdab9b1-fccd-4aa0-9247-b09f813bf14e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:58.098194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdab9b1-fccd-4aa0-9247-b09f813bf14e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:58.130795 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5ecdc-c051-488e-81cf-cabd35af8b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:58.131440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ecdc-c051-488e-81cf-cabd35af8b19 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:58.131720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ecdc-c051-488e-81cf-cabd35af8b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:58.131991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ecdc-c051-488e-81cf-cabd35af8b19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:58.142091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5ecdc-c051-488e-81cf-cabd35af8b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-60d5ecdc-c051-488e-81cf-cabd35af8b19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:09:58.146839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:09:58.148017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:09:58.149285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 445/893] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:09:58.153980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aba77-48b4-4d02-bf9a-583a91c21adf None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:58.217557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:58.250467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aba77-48b4-4d02-bf9a-583a91c21adf None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:58.283379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba329e7f-1820-4721-ad81-61988e8c80cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:58.283968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba329e7f-1820-4721-ad81-61988e8c80cc None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:58.284251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba329e7f-1820-4721-ad81-61988e8c80cc None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:58.284524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba329e7f-1820-4721-ad81-61988e8c80cc None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:58.285178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba329e7f-1820-4721-ad81-61988e8c80cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:09:58.285482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba329e7f-1820-4721-ad81-61988e8c80cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:58.286811 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba329e7f-1820-4721-ad81-61988e8c80cc None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:58.294433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 449/894] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:09:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:58.300121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5ecdc-c051-488e-81cf-cabd35af8b19 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:58.340420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:58.396253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5ecdc-c051-488e-81cf-cabd35af8b19 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:58.428290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8cdf7-62ca-4e50-8123-20624153170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:58.428896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8cdf7-62ca-4e50-8123-20624153170c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:58.429172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8cdf7-62ca-4e50-8123-20624153170c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:58.429441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8cdf7-62ca-4e50-8123-20624153170c None admin] PATH_INFO: `/v3/users/eb7ab44067124f0c8c069e9109dabbb3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:58.441857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8cdf7-62ca-4e50-8123-20624153170c None admin] RBAC: Authorizing `identity:get_user(user_id=eb7ab44067124f0c8c069e9109dabbb3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:58.443284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8cdf7-62ca-4e50-8123-20624153170c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:58.444846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 446/895] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:09:58 2022] GET /identity/v3/users/eb7ab44067124f0c8c069e9109dabbb3 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:09:58.450792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba329e7f-1820-4721-ad81-61988e8c80cc None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:58.544670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba329e7f-1820-4721-ad81-61988e8c80cc None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:58.571340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:58.577552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9304aa-d55f-45c7-9302-33272e147ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:58.578165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9304aa-d55f-45c7-9302-33272e147ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:58.578440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9304aa-d55f-45c7-9302-33272e147ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:58.578707 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9304aa-d55f-45c7-9302-33272e147ff8 None admin] PATH_INFO: `/v3/projects/3c90ae6f423542238fbc761dc46824e6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:58.580332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9304aa-d55f-45c7-9302-33272e147ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=3c90ae6f423542238fbc761dc46824e6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:58.581737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9304aa-d55f-45c7-9302-33272e147ff8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:58.583350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 450/896] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:09:58 2022] GET /identity/v3/projects/3c90ae6f423542238fbc761dc46824e6 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:09:58.589168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8cdf7-62ca-4e50-8123-20624153170c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:09:58.681476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:09:58.685337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8cdf7-62ca-4e50-8123-20624153170c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:09:58.719134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313c839-166e-4087-8b53-e58c68497191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:09:58.719827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313c839-166e-4087-8b53-e58c68497191 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:09:58.720102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313c839-166e-4087-8b53-e58c68497191 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:09:58.720369 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313c839-166e-4087-8b53-e58c68497191 None admin] PATH_INFO: `/v3/projects/3c90ae6f423542238fbc761dc46824e6/users/eb7ab44067124f0c8c069e9109dabbb3/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:09:58.722212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313c839-166e-4087-8b53-e58c68497191 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c90ae6f423542238fbc761dc46824e6, user_id=eb7ab44067124f0c8c069e9109dabbb3, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:09:58.723644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313c839-166e-4087-8b53-e58c68497191 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:09:58.735421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 447/897] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:09:58 2022] PUT /identity/v3/projects/3c90ae6f423542238fbc761dc46824e6/users/eb7ab44067124f0c8c069e9109dabbb3/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:10:00.815825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb711ce-7e4d-4994-aa6d-9ae764ab6273 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:00.816408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb711ce-7e4d-4994-aa6d-9ae764ab6273 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:00.816408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb711ce-7e4d-4994-aa6d-9ae764ab6273 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:00.817689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 451/898] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:10:00.822820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addab2f-1fc6-491c-bb74-4d597b8c11e3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:00.823224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addab2f-1fc6-491c-bb74-4d597b8c11e3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:00.823382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addab2f-1fc6-491c-bb74-4d597b8c11e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:00.841845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2addab2f-1fc6-491c-bb74-4d597b8c11e3 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:10:00.843006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2addab2f-1fc6-491c-bb74-4d597b8c11e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:10:00.907189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 448/899] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:10:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:10:01.169172 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb711ce-7e4d-4994-aa6d-9ae764ab6273 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:10:01.266313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb711ce-7e4d-4994-aa6d-9ae764ab6273 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:10:01.298714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e5fa6-0392-457d-a665-06e65e865a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:10:01.299338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5fa6-0392-457d-a665-06e65e865a25 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:01.299617 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5fa6-0392-457d-a665-06e65e865a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:01.299887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5fa6-0392-457d-a665-06e65e865a25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:01.309972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e5fa6-0392-457d-a665-06e65e865a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-019e5fa6-0392-457d-a665-06e65e865a25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:10:01.314698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:10:01.315891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:10:01.316992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 452/900] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:10:01.321615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addab2f-1fc6-491c-bb74-4d597b8c11e3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:10:01.404889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:10:01.417957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addab2f-1fc6-491c-bb74-4d597b8c11e3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:10:01.450561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493159bd-364a-4acc-a88f-6ee96f5cf852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:10:01.451101 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493159bd-364a-4acc-a88f-6ee96f5cf852 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:01.451411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493159bd-364a-4acc-a88f-6ee96f5cf852 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:01.451689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493159bd-364a-4acc-a88f-6ee96f5cf852 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:01.452339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493159bd-364a-4acc-a88f-6ee96f5cf852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:10:01.452642 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493159bd-364a-4acc-a88f-6ee96f5cf852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:10:01.454472 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493159bd-364a-4acc-a88f-6ee96f5cf852 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:10:01.462220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 449/901] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:10:01.468045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e5fa6-0392-457d-a665-06e65e865a25 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:10:01.523287 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:10:01.562914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e5fa6-0392-457d-a665-06e65e865a25 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:10:01.595921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3454a-17a9-4979-9d4d-f004517a923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:10:01.596536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3454a-17a9-4979-9d4d-f004517a923e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:01.596812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3454a-17a9-4979-9d4d-f004517a923e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:01.597081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3454a-17a9-4979-9d4d-f004517a923e None admin] PATH_INFO: `/v3/users/eb7ab44067124f0c8c069e9109dabbb3` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:01.598176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3454a-17a9-4979-9d4d-f004517a923e None admin] RBAC: Authorizing `identity:get_user(user_id=eb7ab44067124f0c8c069e9109dabbb3)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:10:01.599599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3454a-17a9-4979-9d4d-f004517a923e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:10:01.601126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 453/902] 10.222.0.23 () {56 vars in 1177 bytes} [Fri Oct 21 21:10:01 2022] GET /identity/v3/users/eb7ab44067124f0c8c069e9109dabbb3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:10:01.606730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493159bd-364a-4acc-a88f-6ee96f5cf852 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:10:01.703789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493159bd-364a-4acc-a88f-6ee96f5cf852 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:10:01.736220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06d96d-1118-4615-88c1-02c2e1ca1182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:10:01.736818 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06d96d-1118-4615-88c1-02c2e1ca1182 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:01.737100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06d96d-1118-4615-88c1-02c2e1ca1182 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:01.737374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06d96d-1118-4615-88c1-02c2e1ca1182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:01.755639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:10:01.802709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06d96d-1118-4615-88c1-02c2e1ca1182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:10:01.804169 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06d96d-1118-4615-88c1-02c2e1ca1182 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:10:01.899695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 450/903] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:10:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 21 21:10:01.905534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3454a-17a9-4979-9d4d-f004517a923e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:10:02.004449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3454a-17a9-4979-9d4d-f004517a923e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:10:02.028016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:10:02.036743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435763d7-0826-4639-bc99-de51e4068cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:10:02.037355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435763d7-0826-4639-bc99-de51e4068cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:02.037637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435763d7-0826-4639-bc99-de51e4068cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:02.037914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435763d7-0826-4639-bc99-de51e4068cb9 None admin] PATH_INFO: `/v3/projects/3c90ae6f423542238fbc761dc46824e6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:02.039022 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435763d7-0826-4639-bc99-de51e4068cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=3c90ae6f423542238fbc761dc46824e6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:10:02.040467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435763d7-0826-4639-bc99-de51e4068cb9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:10:02.042054 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 454/904] 10.222.0.23 () {56 vars in 1186 bytes} [Fri Oct 21 21:10:01 2022] GET /identity/v3/projects/3c90ae6f423542238fbc761dc46824e6 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:10:02.048964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06d96d-1118-4615-88c1-02c2e1ca1182 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:10:02.097203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:10:02.146906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06d96d-1118-4615-88c1-02c2e1ca1182 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:10:02.180484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55706c-73e1-4717-a9a2-f1f929a78cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:10:02.181070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55706c-73e1-4717-a9a2-f1f929a78cbc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:02.181344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55706c-73e1-4717-a9a2-f1f929a78cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:02.181612 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55706c-73e1-4717-a9a2-f1f929a78cbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:02.182321 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55706c-73e1-4717-a9a2-f1f929a78cbc None admin] RBAC: Adding query filter params (role.id=58b61e8083c64fd58b3eb63efc4c7e3e, scope.project.id=3c90ae6f423542238fbc761dc46824e6, user.id=eb7ab44067124f0c8c069e9109dabbb3) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:10:02.182633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55706c-73e1-4717-a9a2-f1f929a78cbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:10:02.184065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55706c-73e1-4717-a9a2-f1f929a78cbc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:10:02.190179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 451/905] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:10:02 2022] GET /identity/v3/role_assignments?user.id=eb7ab44067124f0c8c069e9109dabbb3&scope.project.id=3c90ae6f423542238fbc761dc46824e6&role.id=58b61e8083c64fd58b3eb63efc4c7e3e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:10:12.032858 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:10:12.187019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=43 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:10:57.173687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb49d-393a-498e-a673-2bb88c6de1b4 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:57.174271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb49d-393a-498e-a673-2bb88c6de1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:57.174271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbb49d-393a-498e-a673-2bb88c6de1b4 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:57.175591 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 455/906] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:10:57.181303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77092f5c-b004-4ba8-8be6-719c15c4a7a4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:57.181744 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77092f5c-b004-4ba8-8be6-719c15c4a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:57.181829 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77092f5c-b004-4ba8-8be6-719c15c4a7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:57.203053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-77092f5c-b004-4ba8-8be6-719c15c4a7a4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:10:57.204827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-77092f5c-b004-4ba8-8be6-719c15c4a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:10:57.300415 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 452/907] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:10:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:10:57.580722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbb49d-393a-498e-a673-2bb88c6de1b4 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:10:57.734521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbb49d-393a-498e-a673-2bb88c6de1b4 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:10:57.779114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b57e7-a825-429b-b08e-8482558fd849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:10:57.779793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b57e7-a825-429b-b08e-8482558fd849 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:57.780096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b57e7-a825-429b-b08e-8482558fd849 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:57.780399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b57e7-a825-429b-b08e-8482558fd849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:57.792830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b57e7-a825-429b-b08e-8482558fd849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:10:57.794779 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b57e7-a825-429b-b08e-8482558fd849 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-894b57e7-a825-429b-b08e-8482558fd849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:10:57.812550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:10:57.813649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:10:57.814646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:10:57.814646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:10:57.814646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:10:57.814646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 456/908] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:10:57.820495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77092f5c-b004-4ba8-8be6-719c15c4a7a4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:10:57.941789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77092f5c-b004-4ba8-8be6-719c15c4a7a4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:10:57.981778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:10:57.993699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc43a-afa4-4dee-b9f4-9d24d3e03ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:10:57.994426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc43a-afa4-4dee-b9f4-9d24d3e03ccd None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:57.994769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc43a-afa4-4dee-b9f4-9d24d3e03ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:57.995105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc43a-afa4-4dee-b9f4-9d24d3e03ccd None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:57.995963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc43a-afa4-4dee-b9f4-9d24d3e03ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:10:57.996417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc43a-afa4-4dee-b9f4-9d24d3e03ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:10:57.997970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc43a-afa4-4dee-b9f4-9d24d3e03ccd None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:10:58.012517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 453/909] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:10:58.018805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b57e7-a825-429b-b08e-8482558fd849 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:10:58.090854 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:10:58.151451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b57e7-a825-429b-b08e-8482558fd849 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:10:58.195150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ad0d5-9554-46a8-bd32-fa0eb67e6d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:10:58.195816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad0d5-9554-46a8-bd32-fa0eb67e6d53 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:10:58.196063 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad0d5-9554-46a8-bd32-fa0eb67e6d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:10:58.196238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ad0d5-9554-46a8-bd32-fa0eb67e6d53 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:10:58.196886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ad0d5-9554-46a8-bd32-fa0eb67e6d53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:10:58.198302 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ad0d5-9554-46a8-bd32-fa0eb67e6d53 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:10:58.223549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 457/910] 10.222.0.23 () {60 vars in 1132 bytes} [Fri Oct 21 21:10:58 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:11:00.739668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd074bf-4f5e-4aec-b828-00c7e13c9436 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:00.740204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd074bf-4f5e-4aec-b828-00c7e13c9436 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:00.740443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd074bf-4f5e-4aec-b828-00c7e13c9436 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:00.742346 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 454/911] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:11:00.748208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc6db-d9ac-4292-bba1-de125430c944 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:00.749521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc6db-d9ac-4292-bba1-de125430c944 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:00.749521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc6db-d9ac-4292-bba1-de125430c944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:00.769175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-574dc6db-d9ac-4292-bba1-de125430c944 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:11:00.770376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-574dc6db-d9ac-4292-bba1-de125430c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:11:00.853117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 458/912] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:11:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:11:01.162486 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd074bf-4f5e-4aec-b828-00c7e13c9436 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:01.283409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd074bf-4f5e-4aec-b828-00c7e13c9436 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:01.326662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d73a0-b45e-409e-83d6-47d7fa47416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:01.327773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d73a0-b45e-409e-83d6-47d7fa47416e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:01.328048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d73a0-b45e-409e-83d6-47d7fa47416e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:01.328316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d73a0-b45e-409e-83d6-47d7fa47416e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:01.341297 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d73a0-b45e-409e-83d6-47d7fa47416e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-011d73a0-b45e-409e-83d6-47d7fa47416e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:11:01.347865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:01.350451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:01.351336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 455/913] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:11:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:01.357980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dc6db-d9ac-4292-bba1-de125430c944 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:01.408530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:01.491123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dc6db-d9ac-4292-bba1-de125430c944 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:01.529632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db959eb-627f-4d6e-ad76-524f55ba24c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:01.530511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db959eb-627f-4d6e-ad76-524f55ba24c4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:01.530810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db959eb-627f-4d6e-ad76-524f55ba24c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:01.531355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db959eb-627f-4d6e-ad76-524f55ba24c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:01.532389 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db959eb-627f-4d6e-ad76-524f55ba24c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:01.532697 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db959eb-627f-4d6e-ad76-524f55ba24c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:01.534845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db959eb-627f-4d6e-ad76-524f55ba24c4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:01.546555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 459/914] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:11:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:01.552394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d73a0-b45e-409e-83d6-47d7fa47416e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:01.617871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:01.673958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d73a0-b45e-409e-83d6-47d7fa47416e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:01.719653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a8c73-66d2-458e-ac33-100910264c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:01.720299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a8c73-66d2-458e-ac33-100910264c08 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:01.720558 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a8c73-66d2-458e-ac33-100910264c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:01.720836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a8c73-66d2-458e-ac33-100910264c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:01.733157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a8c73-66d2-458e-ac33-100910264c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:01.735317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a8c73-66d2-458e-ac33-100910264c08 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-2a1a8c73-66d2-458e-ac33-100910264c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:11:01.764952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:01.772608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:11:01.773716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:11:01.773716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:01.773716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:01.773716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 456/915] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:01.774166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db959eb-627f-4d6e-ad76-524f55ba24c4 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:01.900170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:01.903403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db959eb-627f-4d6e-ad76-524f55ba24c4 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:01.943363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfa338-dcdb-4cd5-a663-22dc2ad534d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:01.944083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa338-dcdb-4cd5-a663-22dc2ad534d5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:01.944461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa338-dcdb-4cd5-a663-22dc2ad534d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:01.944810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa338-dcdb-4cd5-a663-22dc2ad534d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:01.945459 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfa338-dcdb-4cd5-a663-22dc2ad534d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:01.945766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfa338-dcdb-4cd5-a663-22dc2ad534d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:01.947241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfa338-dcdb-4cd5-a663-22dc2ad534d5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:01.959986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 460/916] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:01.965744 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a8c73-66d2-458e-ac33-100910264c08 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:02.078459 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a8c73-66d2-458e-ac33-100910264c08 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:02.080256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:02.117144 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff310b-c998-437d-a3ef-95d7f85a1bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:02.117963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff310b-c998-437d-a3ef-95d7f85a1bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:02.118244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff310b-c998-437d-a3ef-95d7f85a1bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:02.118513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff310b-c998-437d-a3ef-95d7f85a1bf5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:02.126534 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff310b-c998-437d-a3ef-95d7f85a1bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:02.127996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff310b-c998-437d-a3ef-95d7f85a1bf5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-bbff310b-c998-437d-a3ef-95d7f85a1bf5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:11:02.140007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:02.146113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:02.147408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 457/917] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:02.149198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfa338-dcdb-4cd5-a663-22dc2ad534d5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:02.256329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfa338-dcdb-4cd5-a663-22dc2ad534d5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:02.295278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a451c17-7c0f-4688-9a49-7046b692ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:02.296456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451c17-7c0f-4688-9a49-7046b692ce9a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:02.296921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451c17-7c0f-4688-9a49-7046b692ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:02.297203 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451c17-7c0f-4688-9a49-7046b692ce9a None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:02.298290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a451c17-7c0f-4688-9a49-7046b692ce9a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:02.298597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a451c17-7c0f-4688-9a49-7046b692ce9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:02.300696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a451c17-7c0f-4688-9a49-7046b692ce9a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:02.324298 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 461/918] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Oct 21 21:11:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:11:02.331479 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff310b-c998-437d-a3ef-95d7f85a1bf5 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:02.454652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff310b-c998-437d-a3ef-95d7f85a1bf5 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:02.497684 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ae3d5-d315-4003-b6cf-f5841278f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:02.499186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae3d5-d315-4003-b6cf-f5841278f305 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:02.499763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae3d5-d315-4003-b6cf-f5841278f305 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:02.500095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae3d5-d315-4003-b6cf-f5841278f305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:02.513710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ae3d5-d315-4003-b6cf-f5841278f305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:02.515868 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ae3d5-d315-4003-b6cf-f5841278f305 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-178ae3d5-d315-4003-b6cf-f5841278f305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:11:02.531281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:02.532454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:11:02.533372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:11:02.533372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:02.533372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:02.533372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 458/919] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:02.538134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a451c17-7c0f-4688-9a49-7046b692ce9a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:02.559315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:02.658647 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a451c17-7c0f-4688-9a49-7046b692ce9a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:02.693902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f5c7d-bbd2-4eec-8e06-313694ab0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:02.694512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5c7d-bbd2-4eec-8e06-313694ab0aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:02.694787 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5c7d-bbd2-4eec-8e06-313694ab0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:02.695058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5c7d-bbd2-4eec-8e06-313694ab0aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:02.695740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f5c7d-bbd2-4eec-8e06-313694ab0aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:02.696043 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f5c7d-bbd2-4eec-8e06-313694ab0aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:02.697393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f5c7d-bbd2-4eec-8e06-313694ab0aa7 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:02.709281 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 462/920] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:02.714781 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ae3d5-d315-4003-b6cf-f5841278f305 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:02.731932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:02.842291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ae3d5-d315-4003-b6cf-f5841278f305 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:02.880631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c50f52-06a4-45c8-90b8-e1bb1755cd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:02.881270 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c50f52-06a4-45c8-90b8-e1bb1755cd6d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:02.881548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c50f52-06a4-45c8-90b8-e1bb1755cd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:02.881815 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c50f52-06a4-45c8-90b8-e1bb1755cd6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:02.892689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c50f52-06a4-45c8-90b8-e1bb1755cd6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:02.894406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c50f52-06a4-45c8-90b8-e1bb1755cd6d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-94c50f52-06a4-45c8-90b8-e1bb1755cd6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:11:02.907136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:02.908179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:02.909142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:11:02.909142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:11:02.909142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:11:02.909142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:11:02.909142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:11:02.909142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:11:02.909142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:11:02.909142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:02.909142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 459/921] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:11:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:02.916442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f5c7d-bbd2-4eec-8e06-313694ab0aa7 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:03.003317 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:03.028486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f5c7d-bbd2-4eec-8e06-313694ab0aa7 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:03.070267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832c472-5e7d-477d-895d-ec46cef46e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:03.070988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832c472-5e7d-477d-895d-ec46cef46e1d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:03.071316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832c472-5e7d-477d-895d-ec46cef46e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:03.071686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832c472-5e7d-477d-895d-ec46cef46e1d None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:03.072385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832c472-5e7d-477d-895d-ec46cef46e1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:03.072687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832c472-5e7d-477d-895d-ec46cef46e1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:03.074952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832c472-5e7d-477d-895d-ec46cef46e1d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:03.088615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 463/922] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:11:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:03.096172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c50f52-06a4-45c8-90b8-e1bb1755cd6d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:03.180232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:03.209761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c50f52-06a4-45c8-90b8-e1bb1755cd6d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:03.246713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33c136-c8f2-4c3f-aa74-d34f3fceae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:03.247518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c136-c8f2-4c3f-aa74-d34f3fceae4e None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:03.247795 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c136-c8f2-4c3f-aa74-d34f3fceae4e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:03.248067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c136-c8f2-4c3f-aa74-d34f3fceae4e None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/aa89e84c708f44c299c728284e33fabf/roles/9551be8340204b80958e4788f306cff6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:03.264221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33c136-c8f2-4c3f-aa74-d34f3fceae4e None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=aa89e84c708f44c299c728284e33fabf, role_id=9551be8340204b80958e4788f306cff6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:03.265805 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33c136-c8f2-4c3f-aa74-d34f3fceae4e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:03.280982 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 460/923] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:11:03 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/aa89e84c708f44c299c728284e33fabf/roles/9551be8340204b80958e4788f306cff6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:11:05.553124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc62022-11b5-4ae2-992b-c5a0ab9bde9c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:05.553680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc62022-11b5-4ae2-992b-c5a0ab9bde9c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:05.553780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc62022-11b5-4ae2-992b-c5a0ab9bde9c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:05.555072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 464/924] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:11:05.560552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e934f7-1dcb-474b-9365-dead921b54e3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:05.560962 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e934f7-1dcb-474b-9365-dead921b54e3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:05.561766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e934f7-1dcb-474b-9365-dead921b54e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:05.580213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c1e934f7-1dcb-474b-9365-dead921b54e3 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:11:05.581621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c1e934f7-1dcb-474b-9365-dead921b54e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:11:05.655114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 461/925] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:11:05.956262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc62022-11b5-4ae2-992b-c5a0ab9bde9c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:06.074674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc62022-11b5-4ae2-992b-c5a0ab9bde9c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:06.115454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8fd1f-9ea1-4671-bcb6-8f57ccfc7d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:06.116100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8fd1f-9ea1-4671-bcb6-8f57ccfc7d6c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:06.116379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8fd1f-9ea1-4671-bcb6-8f57ccfc7d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:06.116684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8fd1f-9ea1-4671-bcb6-8f57ccfc7d6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:06.124776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:06.129252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8fd1f-9ea1-4671-bcb6-8f57ccfc7d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-57e8fd1f-9ea1-4671-bcb6-8f57ccfc7d6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:11:06.134844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:06.135857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:11:06.136690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 465/926] 10.222.0.23 () {56 vars in 1102 bytes} [Fri Oct 21 21:11:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:06.142641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e934f7-1dcb-474b-9365-dead921b54e3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:06.201128 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:06.249780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e934f7-1dcb-474b-9365-dead921b54e3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:06.288111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31708f96-4d80-49dd-b852-87fff5323cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:06.288724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31708f96-4d80-49dd-b852-87fff5323cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:06.289005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31708f96-4d80-49dd-b852-87fff5323cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:06.289277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31708f96-4d80-49dd-b852-87fff5323cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:06.289942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31708f96-4d80-49dd-b852-87fff5323cd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:06.290245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31708f96-4d80-49dd-b852-87fff5323cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:06.291642 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31708f96-4d80-49dd-b852-87fff5323cd7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:06.302233 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 462/927] 10.222.0.23 () {56 vars in 1103 bytes} [Fri Oct 21 21:11:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:06.308971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8fd1f-9ea1-4671-bcb6-8f57ccfc7d6c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:06.428254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8fd1f-9ea1-4671-bcb6-8f57ccfc7d6c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:06.467379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732eb254-4898-4873-a594-c40e68ffda48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:06.468366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732eb254-4898-4873-a594-c40e68ffda48 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:06.468903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732eb254-4898-4873-a594-c40e68ffda48 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:06.469359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732eb254-4898-4873-a594-c40e68ffda48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:06.482575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732eb254-4898-4873-a594-c40e68ffda48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:06.485011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732eb254-4898-4873-a594-c40e68ffda48 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-732eb254-4898-4873-a594-c40e68ffda48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:11:06.502041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:06.503134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:11:06.504245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:11:06.504245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:06.504245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:11:06.504245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 466/928] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 21 21:11:06.508852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31708f96-4d80-49dd-b852-87fff5323cd7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:06.615119 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31708f96-4d80-49dd-b852-87fff5323cd7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:06.632849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:06.652115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144fe82-9137-4f1d-a5c8-74fbe8d7f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:06.652789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fe82-9137-4f1d-a5c8-74fbe8d7f084 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:06.653121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fe82-9137-4f1d-a5c8-74fbe8d7f084 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:06.653439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144fe82-9137-4f1d-a5c8-74fbe8d7f084 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:06.654179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fe82-9137-4f1d-a5c8-74fbe8d7f084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:06.654486 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fe82-9137-4f1d-a5c8-74fbe8d7f084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:06.656126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144fe82-9137-4f1d-a5c8-74fbe8d7f084 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:06.668279 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 463/929] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:06.675320 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732eb254-4898-4873-a594-c40e68ffda48 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:06.728096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:06.789587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732eb254-4898-4873-a594-c40e68ffda48 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:06.828473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6850f-e420-4ecb-95b1-7277dedc6d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:06.829388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6850f-e420-4ecb-95b1-7277dedc6d30 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:06.829766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6850f-e420-4ecb-95b1-7277dedc6d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:06.830045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6850f-e420-4ecb-95b1-7277dedc6d30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:06.839377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6850f-e420-4ecb-95b1-7277dedc6d30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:06.841294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6850f-e420-4ecb-95b1-7277dedc6d30 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-a6a6850f-e420-4ecb-95b1-7277dedc6d30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:11:06.856292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:06.863660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:11:06.864804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 467/930] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:06.865524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144fe82-9137-4f1d-a5c8-74fbe8d7f084 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:06.979680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144fe82-9137-4f1d-a5c8-74fbe8d7f084 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:07.020094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c375bbd-8594-4f47-8b1c-472099fbfb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:07.020747 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c375bbd-8594-4f47-8b1c-472099fbfb4d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:07.021097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c375bbd-8594-4f47-8b1c-472099fbfb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:07.021416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c375bbd-8594-4f47-8b1c-472099fbfb4d None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:07.022171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c375bbd-8594-4f47-8b1c-472099fbfb4d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:07.022466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c375bbd-8594-4f47-8b1c-472099fbfb4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:07.023960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c375bbd-8594-4f47-8b1c-472099fbfb4d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:07.042745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 464/931] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Oct 21 21:11:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:07.049140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6850f-e420-4ecb-95b1-7277dedc6d30 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:07.165261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6850f-e420-4ecb-95b1-7277dedc6d30 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:07.176427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:07.205128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152922-d92f-464a-978b-2ca3e3bb35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:07.205734 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152922-d92f-464a-978b-2ca3e3bb35be None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:07.206011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152922-d92f-464a-978b-2ca3e3bb35be None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:07.206276 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152922-d92f-464a-978b-2ca3e3bb35be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:07.276543 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91152922-d92f-464a-978b-2ca3e3bb35be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:07.277989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91152922-d92f-464a-978b-2ca3e3bb35be None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:07.386795 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 468/932] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:11:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 21 21:11:07.393588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c375bbd-8594-4f47-8b1c-472099fbfb4d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:07.431070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:07.501474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c375bbd-8594-4f47-8b1c-472099fbfb4d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:07.543769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210174f3-e95a-447d-a0f3-4d835189a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:07.544617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210174f3-e95a-447d-a0f3-4d835189a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:07.544922 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210174f3-e95a-447d-a0f3-4d835189a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:07.545102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210174f3-e95a-447d-a0f3-4d835189a2a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:07.555759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210174f3-e95a-447d-a0f3-4d835189a2a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:07.557284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210174f3-e95a-447d-a0f3-4d835189a2a3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-210174f3-e95a-447d-a0f3-4d835189a2a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:11:07.573162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:07.574544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:11:07.576120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:11:07.576120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:07.576120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:07.576120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 465/933] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:07.580924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152922-d92f-464a-978b-2ca3e3bb35be None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:07.594653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:07.686925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152922-d92f-464a-978b-2ca3e3bb35be None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:07.724034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad0071-6677-485e-97cc-8034704e7008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:07.724641 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad0071-6677-485e-97cc-8034704e7008 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:07.724920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad0071-6677-485e-97cc-8034704e7008 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:07.725192 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad0071-6677-485e-97cc-8034704e7008 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:07.725860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad0071-6677-485e-97cc-8034704e7008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:07.726161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad0071-6677-485e-97cc-8034704e7008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:07.727554 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad0071-6677-485e-97cc-8034704e7008 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:07.738851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 469/934] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:11:07.744359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210174f3-e95a-447d-a0f3-4d835189a2a3 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:07.836474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:07.851784 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210174f3-e95a-447d-a0f3-4d835189a2a3 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:07.887857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ad37-b028-4922-a641-a9a2658f494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:07.888477 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ad37-b028-4922-a641-a9a2658f494c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:07.888756 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ad37-b028-4922-a641-a9a2658f494c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:07.889104 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ad37-b028-4922-a641-a9a2658f494c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:07.896143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4ad37-b028-4922-a641-a9a2658f494c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:07.897572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4ad37-b028-4922-a641-a9a2658f494c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-27c4ad37-b028-4922-a641-a9a2658f494c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:11:07.908751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:07.909901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:07.910974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:11:07.910974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:11:07.910974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:11:07.910974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:11:07.910974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:11:07.910974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:11:07.910974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:11:07.910974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:07.910974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 466/935] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:07.916910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad0071-6677-485e-97cc-8034704e7008 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:07.988792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:08.024200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad0071-6677-485e-97cc-8034704e7008 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:08.060888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe75bc-fcdc-49c3-94a4-9a21fc3f69ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:08.061579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe75bc-fcdc-49c3-94a4-9a21fc3f69ac None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:08.061860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe75bc-fcdc-49c3-94a4-9a21fc3f69ac None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:08.062134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe75bc-fcdc-49c3-94a4-9a21fc3f69ac None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:08.062827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe75bc-fcdc-49c3-94a4-9a21fc3f69ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:08.063133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe75bc-fcdc-49c3-94a4-9a21fc3f69ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:08.064579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe75bc-fcdc-49c3-94a4-9a21fc3f69ac None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:08.077513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 470/936] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:08.083853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ad37-b028-4922-a641-a9a2658f494c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:08.189300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ad37-b028-4922-a641-a9a2658f494c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:08.225606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ee842-3f7b-4e29-9651-7801cd19571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:08.226213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee842-3f7b-4e29-9651-7801cd19571a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:08.226499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee842-3f7b-4e29-9651-7801cd19571a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:08.226867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee842-3f7b-4e29-9651-7801cd19571a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:08.228425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ee842-3f7b-4e29-9651-7801cd19571a None admin] RBAC: Adding query filter params (role.id=9551be8340204b80958e4788f306cff6, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=aa89e84c708f44c299c728284e33fabf) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:08.228425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ee842-3f7b-4e29-9651-7801cd19571a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:08.229324 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ee842-3f7b-4e29-9651-7801cd19571a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:08.235102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 467/937] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:11:08 2022] GET /identity/v3/role_assignments?user.id=aa89e84c708f44c299c728284e33fabf&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=9551be8340204b80958e4788f306cff6 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:10.619328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b5c5-278e-4f27-93cc-b2cfa488e145 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:10.619885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b5c5-278e-4f27-93cc-b2cfa488e145 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:10.619885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b5c5-278e-4f27-93cc-b2cfa488e145 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:10.621218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 471/938] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:11:10.627101 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e873a-3833-492c-a5a5-3611fb617545 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:10.627564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e873a-3833-492c-a5a5-3611fb617545 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:10.627710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e873a-3833-492c-a5a5-3611fb617545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:10.647128 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f08e873a-3833-492c-a5a5-3611fb617545 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:11:10.648365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f08e873a-3833-492c-a5a5-3611fb617545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:11:10.651179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:10.721942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 468/939] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:11:10.998039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4b5c5-278e-4f27-93cc-b2cfa488e145 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:11.117611 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4b5c5-278e-4f27-93cc-b2cfa488e145 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:11.150410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:11.156658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd146e-15e9-488d-bf35-78945e3df1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:11.157289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd146e-15e9-488d-bf35-78945e3df1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:11.157573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd146e-15e9-488d-bf35-78945e3df1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:11.157848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd146e-15e9-488d-bf35-78945e3df1b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:11.168191 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd146e-15e9-488d-bf35-78945e3df1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-debd146e-15e9-488d-bf35-78945e3df1b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:11:11.174015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:11.175220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:11:11.176393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 472/940] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:11:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:11.181312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e873a-3833-492c-a5a5-3611fb617545 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:11.290541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e873a-3833-492c-a5a5-3611fb617545 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:11.329915 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6a606-d400-4bb9-9c50-3d8715817fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:11.330556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6a606-d400-4bb9-9c50-3d8715817fef None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:11.330841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6a606-d400-4bb9-9c50-3d8715817fef None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:11.331164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6a606-d400-4bb9-9c50-3d8715817fef None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:11.331942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6a606-d400-4bb9-9c50-3d8715817fef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:11.332281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6a606-d400-4bb9-9c50-3d8715817fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:11.333687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6a606-d400-4bb9-9c50-3d8715817fef None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:11.342340 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 469/941] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:11.349269 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd146e-15e9-488d-bf35-78945e3df1b0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:11.457684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd146e-15e9-488d-bf35-78945e3df1b0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:11.493447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec9ee5-4b7a-4024-b468-5f85c1feddf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:11.494077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec9ee5-4b7a-4024-b468-5f85c1feddf5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:11.494357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec9ee5-4b7a-4024-b468-5f85c1feddf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:11.494629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec9ee5-4b7a-4024-b468-5f85c1feddf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:11.505233 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec9ee5-4b7a-4024-b468-5f85c1feddf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:11.506677 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec9ee5-4b7a-4024-b468-5f85c1feddf5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-16ec9ee5-4b7a-4024-b468-5f85c1feddf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:11:11.524194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:11.525415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:11:11.526380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:11:11.526380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:11.526380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:11:11.526380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 473/942] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:11.531492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6a606-d400-4bb9-9c50-3d8715817fef None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:11.534486 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:11.641561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6a606-d400-4bb9-9c50-3d8715817fef None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:11.677418 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e36483-8bf3-40f1-8395-389c389986c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:11.678094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e36483-8bf3-40f1-8395-389c389986c6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:11.678353 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e36483-8bf3-40f1-8395-389c389986c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:11.678714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e36483-8bf3-40f1-8395-389c389986c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:11.679389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e36483-8bf3-40f1-8395-389c389986c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:11.679697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e36483-8bf3-40f1-8395-389c389986c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:11.681192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e36483-8bf3-40f1-8395-389c389986c6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:11.694470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 470/943] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:11.701617 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec9ee5-4b7a-4024-b468-5f85c1feddf5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:11.747554 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:11.810388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec9ee5-4b7a-4024-b468-5f85c1feddf5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:11.847075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cd91e-403c-48a1-9b75-d0a2631f2654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:11.847735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cd91e-403c-48a1-9b75-d0a2631f2654 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:11.848073 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cd91e-403c-48a1-9b75-d0a2631f2654 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:11.848347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cd91e-403c-48a1-9b75-d0a2631f2654 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:11.856399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cd91e-403c-48a1-9b75-d0a2631f2654 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:11.858459 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cd91e-403c-48a1-9b75-d0a2631f2654 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-b94cd91e-403c-48a1-9b75-d0a2631f2654 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:11:11.869939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:11.871353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:11:11.873117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 474/944] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:11.877652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e36483-8bf3-40f1-8395-389c389986c6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:11.943021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:11.988548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e36483-8bf3-40f1-8395-389c389986c6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:12.029132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083d7d6-f785-4910-a3d8-79e74f3d3864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:12.029945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083d7d6-f785-4910-a3d8-79e74f3d3864 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:12.030303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083d7d6-f785-4910-a3d8-79e74f3d3864 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:12.030613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083d7d6-f785-4910-a3d8-79e74f3d3864 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:12.031755 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083d7d6-f785-4910-a3d8-79e74f3d3864 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:12.032069 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083d7d6-f785-4910-a3d8-79e74f3d3864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:12.034284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083d7d6-f785-4910-a3d8-79e74f3d3864 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:12.057600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 471/945] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Oct 21 21:11:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:12.064400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cd91e-403c-48a1-9b75-d0a2631f2654 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:12.176202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cd91e-403c-48a1-9b75-d0a2631f2654 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:12.177784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:12.216892 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5cc0a-7d61-4aa8-8ec4-6db37e61932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:12.217965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5cc0a-7d61-4aa8-8ec4-6db37e61932d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:12.218439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5cc0a-7d61-4aa8-8ec4-6db37e61932d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:12.218720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5cc0a-7d61-4aa8-8ec4-6db37e61932d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:12.230294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5cc0a-7d61-4aa8-8ec4-6db37e61932d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:12.231758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5cc0a-7d61-4aa8-8ec4-6db37e61932d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-01a5cc0a-7d61-4aa8-8ec4-6db37e61932d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:11:12.247194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:12.248378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:11:12.249266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:11:12.249266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:12.249266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:11:12.249266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 475/946] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:12.254609 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083d7d6-f785-4910-a3d8-79e74f3d3864 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:12.372103 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083d7d6-f785-4910-a3d8-79e74f3d3864 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:12.394272 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:12.410964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef02f8c-2045-4c01-a60c-b38117d8d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:12.411692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02f8c-2045-4c01-a60c-b38117d8d274 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:12.412032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02f8c-2045-4c01-a60c-b38117d8d274 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:12.412344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02f8c-2045-4c01-a60c-b38117d8d274 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:12.413033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef02f8c-2045-4c01-a60c-b38117d8d274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:12.413401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef02f8c-2045-4c01-a60c-b38117d8d274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:12.414957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef02f8c-2045-4c01-a60c-b38117d8d274 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:12.429108 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 472/947] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:12.435948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5cc0a-7d61-4aa8-8ec4-6db37e61932d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:12.548569 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5cc0a-7d61-4aa8-8ec4-6db37e61932d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:12.589404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea5bcd-bb63-4512-a7b6-f7c381d6076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:12.590104 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5bcd-bb63-4512-a7b6-f7c381d6076a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:12.590376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5bcd-bb63-4512-a7b6-f7c381d6076a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:12.590667 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5bcd-bb63-4512-a7b6-f7c381d6076a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:12.599940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea5bcd-bb63-4512-a7b6-f7c381d6076a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:12.601792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea5bcd-bb63-4512-a7b6-f7c381d6076a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-a4ea5bcd-bb63-4512-a7b6-f7c381d6076a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:11:12.614338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:12.615387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:12.616318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:11:12.616318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:11:12.616318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:11:12.616318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:11:12.616318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:11:12.616318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:11:12.616318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:11:12.616318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:11:12.616318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 476/948] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:11:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:12.621589 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef02f8c-2045-4c01-a60c-b38117d8d274 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:12.736552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef02f8c-2045-4c01-a60c-b38117d8d274 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:12.781021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb8212-ade0-4b8f-ab92-c4e11d9b941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:12.781716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb8212-ade0-4b8f-ab92-c4e11d9b941e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:12.781995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb8212-ade0-4b8f-ab92-c4e11d9b941e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:12.782338 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb8212-ade0-4b8f-ab92-c4e11d9b941e None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:12.783112 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb8212-ade0-4b8f-ab92-c4e11d9b941e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:12.783481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb8212-ade0-4b8f-ab92-c4e11d9b941e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:12.785648 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb8212-ade0-4b8f-ab92-c4e11d9b941e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:12.799425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 473/949] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:11:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:12.805976 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea5bcd-bb63-4512-a7b6-f7c381d6076a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:12.825294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:12.920755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea5bcd-bb63-4512-a7b6-f7c381d6076a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:12.958472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2add6-43cf-445b-a09c-533b46c9fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:12.959196 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2add6-43cf-445b-a09c-533b46c9fbd8 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:12.959546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2add6-43cf-445b-a09c-533b46c9fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:12.959774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2add6-43cf-445b-a09c-533b46c9fbd8 None admin] PATH_INFO: `/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/aa89e84c708f44c299c728284e33fabf/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:12.961831 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2add6-43cf-445b-a09c-533b46c9fbd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7964cc909c4f46ef8af4195c66900ca7, user_id=aa89e84c708f44c299c728284e33fabf, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:12.963369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2add6-43cf-445b-a09c-533b46c9fbd8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:12.975706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 477/950] 10.222.0.23 () {58 vars in 1439 bytes} [Fri Oct 21 21:11:12 2022] PUT /identity/v3/projects/7964cc909c4f46ef8af4195c66900ca7/users/aa89e84c708f44c299c728284e33fabf/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:11:15.196042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4afb54-f13f-458d-98ed-c515b10aeff1 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:15.196613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4afb54-f13f-458d-98ed-c515b10aeff1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:15.196613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4afb54-f13f-458d-98ed-c515b10aeff1 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:15.197912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 474/951] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:11:15.203900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1aa12-8bb5-4589-a345-0c7c720793d7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:15.204332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1aa12-8bb5-4589-a345-0c7c720793d7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:15.204494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1aa12-8bb5-4589-a345-0c7c720793d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:15.222758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-49f1aa12-8bb5-4589-a345-0c7c720793d7 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:11:15.224018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-49f1aa12-8bb5-4589-a345-0c7c720793d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:11:15.293587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 478/952] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:11:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:11:15.563370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4afb54-f13f-458d-98ed-c515b10aeff1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:15.614411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:15.702457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4afb54-f13f-458d-98ed-c515b10aeff1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:15.740281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51798e9e-4c3a-4892-8587-79efa933e763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:15.741301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51798e9e-4c3a-4892-8587-79efa933e763 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:15.741607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51798e9e-4c3a-4892-8587-79efa933e763 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:15.742041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51798e9e-4c3a-4892-8587-79efa933e763 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:15.754859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51798e9e-4c3a-4892-8587-79efa933e763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-51798e9e-4c3a-4892-8587-79efa933e763 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 21 21:11:15.761336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:15.762301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:15.763160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 475/953] 10.222.0.23 () {56 vars in 1096 bytes} [Fri Oct 21 21:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:15.769126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1aa12-8bb5-4589-a345-0c7c720793d7 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:15.773356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:15.895747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1aa12-8bb5-4589-a345-0c7c720793d7 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:15.933999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f9cb5-81c1-4210-8f80-2b0269749bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:15.934619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f9cb5-81c1-4210-8f80-2b0269749bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:15.934897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f9cb5-81c1-4210-8f80-2b0269749bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:15.935197 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f9cb5-81c1-4210-8f80-2b0269749bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:15.936046 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f9cb5-81c1-4210-8f80-2b0269749bd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:15.936349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f9cb5-81c1-4210-8f80-2b0269749bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:15.937919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f9cb5-81c1-4210-8f80-2b0269749bd8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:15.946992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 479/954] 10.222.0.23 () {56 vars in 1099 bytes} [Fri Oct 21 21:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:15.953239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51798e9e-4c3a-4892-8587-79efa933e763 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:16.071630 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:16.075801 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51798e9e-4c3a-4892-8587-79efa933e763 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:16.121327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e4ffb-4b67-45cb-8e14-3cbbe6d258dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:16.122309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4ffb-4b67-45cb-8e14-3cbbe6d258dd None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:16.122729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4ffb-4b67-45cb-8e14-3cbbe6d258dd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:16.123034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4ffb-4b67-45cb-8e14-3cbbe6d258dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:16.134980 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e4ffb-4b67-45cb-8e14-3cbbe6d258dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:16.136437 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e4ffb-4b67-45cb-8e14-3cbbe6d258dd None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-213e4ffb-4b67-45cb-8e14-3cbbe6d258dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:11:16.152556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:16.153733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:11:16.155195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:11:16.155195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:16.155195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:16.155195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 476/955] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:16.160142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f9cb5-81c1-4210-8f80-2b0269749bd8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:16.231600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:16.272824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f9cb5-81c1-4210-8f80-2b0269749bd8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:16.309632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4a4ee-f946-4535-bf0b-a02668866c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:16.310269 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4a4ee-f946-4535-bf0b-a02668866c7f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:16.310552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4a4ee-f946-4535-bf0b-a02668866c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:16.310907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4a4ee-f946-4535-bf0b-a02668866c7f None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:16.311608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4a4ee-f946-4535-bf0b-a02668866c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:16.311915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4a4ee-f946-4535-bf0b-a02668866c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:16.313312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4a4ee-f946-4535-bf0b-a02668866c7f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:16.327427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 480/956] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:16.333695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e4ffb-4b67-45cb-8e14-3cbbe6d258dd None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:16.438716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e4ffb-4b67-45cb-8e14-3cbbe6d258dd None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:16.474629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c43dc-e3bc-441c-8485-78e4123d4d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:16.475295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c43dc-e3bc-441c-8485-78e4123d4d27 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:16.475633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c43dc-e3bc-441c-8485-78e4123d4d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:16.475901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c43dc-e3bc-441c-8485-78e4123d4d27 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:16.484161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c43dc-e3bc-441c-8485-78e4123d4d27 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:16.485602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c43dc-e3bc-441c-8485-78e4123d4d27 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-9d5c43dc-e3bc-441c-8485-78e4123d4d27 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 21 21:11:16.497116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:16.498122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:16.499090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:16.499090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:16.499090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 21 21:11:16.499090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 21 21:11:16.499090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 21 21:11:16.499090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 21 21:11:16.499090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 21 21:11:16.499090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 21 21:11:16.499090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 21 21:11:16.499090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:16.503069 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 477/957] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:16.504310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4a4ee-f946-4535-bf0b-a02668866c7f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:16.611344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4a4ee-f946-4535-bf0b-a02668866c7f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:16.638031 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:16.648220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c417f5-aeff-4736-b815-982a17ca2a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:16.648837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c417f5-aeff-4736-b815-982a17ca2a84 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:16.649116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c417f5-aeff-4736-b815-982a17ca2a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:16.649388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c417f5-aeff-4736-b815-982a17ca2a84 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:16.650128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c417f5-aeff-4736-b815-982a17ca2a84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:16.650444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c417f5-aeff-4736-b815-982a17ca2a84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:16.651901 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c417f5-aeff-4736-b815-982a17ca2a84 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:16.670214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 481/958] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Oct 21 21:11:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:16.676020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c43dc-e3bc-441c-8485-78e4123d4d27 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:16.692028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:16.789090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c43dc-e3bc-441c-8485-78e4123d4d27 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:16.832892 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc803e24-4706-4b67-a587-e6bae520cd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:16.833513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc803e24-4706-4b67-a587-e6bae520cd38 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:16.833788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc803e24-4706-4b67-a587-e6bae520cd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:16.834058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc803e24-4706-4b67-a587-e6bae520cd38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:16.900805 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc803e24-4706-4b67-a587-e6bae520cd38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:16.902224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc803e24-4706-4b67-a587-e6bae520cd38 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:16.915729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:17.000828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 478/959] 10.222.0.23 () {58 vars in 1282 bytes} [Fri Oct 21 21:11:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 21 21:11:17.006540 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c417f5-aeff-4736-b815-982a17ca2a84 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:17.103351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c417f5-aeff-4736-b815-982a17ca2a84 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:17.136128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebf861-151a-435b-b0b6-a625aee64915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:17.136749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebf861-151a-435b-b0b6-a625aee64915 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:17.137027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebf861-151a-435b-b0b6-a625aee64915 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:17.137300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebf861-151a-435b-b0b6-a625aee64915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:17.146855 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebf861-151a-435b-b0b6-a625aee64915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:17.148300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebf861-151a-435b-b0b6-a625aee64915 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-acebf861-151a-435b-b0b6-a625aee64915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 21 21:11:17.162204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:17.163371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 21 21:11:17.164613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 21 21:11:17.164613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 21 21:11:17.164613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:11:17.164613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 482/960] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:17.169055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc803e24-4706-4b67-a587-e6bae520cd38 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:17.265023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc803e24-4706-4b67-a587-e6bae520cd38 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:17.277526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:17.299380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccadc42-7a0c-4b11-af79-9620b7999b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:17.299977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccadc42-7a0c-4b11-af79-9620b7999b9d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:17.300254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccadc42-7a0c-4b11-af79-9620b7999b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:17.300524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccadc42-7a0c-4b11-af79-9620b7999b9d None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:17.301159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccadc42-7a0c-4b11-af79-9620b7999b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:17.301461 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccadc42-7a0c-4b11-af79-9620b7999b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:17.302805 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccadc42-7a0c-4b11-af79-9620b7999b9d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:17.314240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 479/961] 10.222.0.23 () {56 vars in 1109 bytes} [Fri Oct 21 21:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:17.319960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebf861-151a-435b-b0b6-a625aee64915 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:17.354308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:17.417051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebf861-151a-435b-b0b6-a625aee64915 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:17.449047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f713d-7ec4-4306-98ef-9081eb4190ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:17.449651 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f713d-7ec4-4306-98ef-9081eb4190ba None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:17.449926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f713d-7ec4-4306-98ef-9081eb4190ba None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:17.450195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f713d-7ec4-4306-98ef-9081eb4190ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:17.456563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f713d-7ec4-4306-98ef-9081eb4190ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:17.457973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f713d-7ec4-4306-98ef-9081eb4190ba None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-ca4f713d-7ec4-4306-98ef-9081eb4190ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 21 21:11:17.469267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:17.470285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:17.471407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 21 21:11:17.471407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 21 21:11:17.471407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 21 21:11:17.471407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 21 21:11:17.471407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 21 21:11:17.471407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 21 21:11:17.471407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 21 21:11:17.471407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 21 21:11:17.471407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 483/962] 10.222.0.23 () {56 vars in 1111 bytes} [Fri Oct 21 21:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:17.476172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccadc42-7a0c-4b11-af79-9620b7999b9d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:17.572287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccadc42-7a0c-4b11-af79-9620b7999b9d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:17.604353 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7da1a-9d60-4d68-870e-b561f4c929f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:17.604938 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7da1a-9d60-4d68-870e-b561f4c929f9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:17.605211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7da1a-9d60-4d68-870e-b561f4c929f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:17.605480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7da1a-9d60-4d68-870e-b561f4c929f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:17.606159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7da1a-9d60-4d68-870e-b561f4c929f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:17.606446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7da1a-9d60-4d68-870e-b561f4c929f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:17.608454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7da1a-9d60-4d68-870e-b561f4c929f9 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:17.619741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 480/963] 10.222.0.23 () {56 vars in 1148 bytes} [Fri Oct 21 21:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:17.625770 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f713d-7ec4-4306-98ef-9081eb4190ba None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:17.717587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:17.723566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f713d-7ec4-4306-98ef-9081eb4190ba None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:17.755457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde5c90-cff9-4eb1-9311-e92bedcb52e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:17.756046 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde5c90-cff9-4eb1-9311-e92bedcb52e7 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:17.756325 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde5c90-cff9-4eb1-9311-e92bedcb52e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:17.756597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde5c90-cff9-4eb1-9311-e92bedcb52e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:17.757313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde5c90-cff9-4eb1-9311-e92bedcb52e7 None admin] RBAC: Adding query filter params (role.id=58b61e8083c64fd58b3eb63efc4c7e3e, scope.project.id=7964cc909c4f46ef8af4195c66900ca7, user.id=aa89e84c708f44c299c728284e33fabf) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:17.757620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde5c90-cff9-4eb1-9311-e92bedcb52e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:17.759043 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde5c90-cff9-4eb1-9311-e92bedcb52e7 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:17.766259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 484/964] 10.222.0.23 () {56 vars in 1374 bytes} [Fri Oct 21 21:11:17 2022] GET /identity/v3/role_assignments?user.id=aa89e84c708f44c299c728284e33fabf&scope.project.id=7964cc909c4f46ef8af4195c66900ca7&role.id=58b61e8083c64fd58b3eb63efc4c7e3e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:19.895400 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993510d7-9dd7-4323-ab3e-a2231bb615e4 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:19.895927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993510d7-9dd7-4323-ab3e-a2231bb615e4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:19.895927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993510d7-9dd7-4323-ab3e-a2231bb615e4 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:19.897279 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 481/965] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:11:19.902532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e2964-224e-4199-8bb9-0d957395c72b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:19.902928 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e2964-224e-4199-8bb9-0d957395c72b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:19.903116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e2964-224e-4199-8bb9-0d957395c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:19.922171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-161e2964-224e-4199-8bb9-0d957395c72b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:11:19.923391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-161e2964-224e-4199-8bb9-0d957395c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:11:19.987380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 485/966] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:11:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:11:20.248136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993510d7-9dd7-4323-ab3e-a2231bb615e4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:20.278702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:20.347710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993510d7-9dd7-4323-ab3e-a2231bb615e4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:20.380185 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec271612-0db7-4752-9651-38f56b66140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:20.380802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec271612-0db7-4752-9651-38f56b66140e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:20.381081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec271612-0db7-4752-9651-38f56b66140e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:20.381351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec271612-0db7-4752-9651-38f56b66140e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:20.381918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec271612-0db7-4752-9651-38f56b66140e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:20.383299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec271612-0db7-4752-9651-38f56b66140e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-ec271612-0db7-4752-9651-38f56b66140e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:20.392356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:20.393535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:20.394720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 482/967] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 21 21:11:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:20.399411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e2964-224e-4199-8bb9-0d957395c72b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:20.485446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:20.495026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e2964-224e-4199-8bb9-0d957395c72b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:20.528476 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d0c06-8c48-436f-8f59-e4f7f518a193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:20.529018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d0c06-8c48-436f-8f59-e4f7f518a193 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:20.529326 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d0c06-8c48-436f-8f59-e4f7f518a193 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:20.529601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d0c06-8c48-436f-8f59-e4f7f518a193 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:20.530225 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d0c06-8c48-436f-8f59-e4f7f518a193 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:20.530528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d0c06-8c48-436f-8f59-e4f7f518a193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:20.531906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d0c06-8c48-436f-8f59-e4f7f518a193 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:20.536567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 486/968] 10.222.0.23 () {56 vars in 1116 bytes} [Fri Oct 21 21:11:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:20.542323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec271612-0db7-4752-9651-38f56b66140e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:20.632873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:20.639610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec271612-0db7-4752-9651-38f56b66140e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:20.671956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fe211-8ba4-42c0-885d-342c4578a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:20.672539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fe211-8ba4-42c0-885d-342c4578a419 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:20.672813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fe211-8ba4-42c0-885d-342c4578a419 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:20.673080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fe211-8ba4-42c0-885d-342c4578a419 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:20.673690 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fe211-8ba4-42c0-885d-342c4578a419 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:20.673984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fe211-8ba4-42c0-885d-342c4578a419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:20.675351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fe211-8ba4-42c0-885d-342c4578a419 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:20.679615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 483/969] 10.222.0.23 () {56 vars in 1116 bytes} [Fri Oct 21 21:11:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:22.803642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab966-fbf9-4ba0-b8ff-5ce8246e4f84 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:22.804227 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab966-fbf9-4ba0-b8ff-5ce8246e4f84 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:22.804227 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab966-fbf9-4ba0-b8ff-5ce8246e4f84 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:22.805506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 487/970] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:11:22.810705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56184d-ea3b-40a6-81f3-0742622db829 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:22.811126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56184d-ea3b-40a6-81f3-0742622db829 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:22.811294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56184d-ea3b-40a6-81f3-0742622db829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:22.829470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ee56184d-ea3b-40a6-81f3-0742622db829 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:11:22.830660 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ee56184d-ea3b-40a6-81f3-0742622db829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:11:22.896154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 484/971] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:11:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:11:23.166026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab966-fbf9-4ba0-b8ff-5ce8246e4f84 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:23.262702 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab966-fbf9-4ba0-b8ff-5ce8246e4f84 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:23.296432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00398872-81fb-45a8-8ef2-de420245cd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:23.297031 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00398872-81fb-45a8-8ef2-de420245cd51 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:23.297311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00398872-81fb-45a8-8ef2-de420245cd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:23.297586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00398872-81fb-45a8-8ef2-de420245cd51 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:23.298231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00398872-81fb-45a8-8ef2-de420245cd51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:23.299601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00398872-81fb-45a8-8ef2-de420245cd51 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:23.313852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 488/972] 10.222.0.23 () {60 vars in 1141 bytes} [Fri Oct 21 21:11:23 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:11:25.449171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3a860-7707-43b6-96dd-216574c70ee4 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:25.449700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3a860-7707-43b6-96dd-216574c70ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:25.449700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3a860-7707-43b6-96dd-216574c70ee4 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:25.451611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 485/973] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:11:25.456807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce299-78ee-4d10-8cc9-1f7c766d6bdb None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:25.457226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce299-78ee-4d10-8cc9-1f7c766d6bdb None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:25.457363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce299-78ee-4d10-8cc9-1f7c766d6bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:25.475870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e42ce299-78ee-4d10-8cc9-1f7c766d6bdb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:11:25.477058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e42ce299-78ee-4d10-8cc9-1f7c766d6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:11:25.486018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:25.548391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 489/974] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:11:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 21 21:11:25.814693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3a860-7707-43b6-96dd-216574c70ee4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:25.903066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:25.914104 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3a860-7707-43b6-96dd-216574c70ee4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:25.947251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa925a7-b2ab-457d-a3e9-10bd7cd7be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:25.947897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa925a7-b2ab-457d-a3e9-10bd7cd7be35 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:25.948426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa925a7-b2ab-457d-a3e9-10bd7cd7be35 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:25.948697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa925a7-b2ab-457d-a3e9-10bd7cd7be35 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:25.949263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa925a7-b2ab-457d-a3e9-10bd7cd7be35 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:25.950613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa925a7-b2ab-457d-a3e9-10bd7cd7be35 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-4fa925a7-b2ab-457d-a3e9-10bd7cd7be35 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:25.959687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:25.960946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:25.962166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 486/975] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 21 21:11:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:25.967309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce299-78ee-4d10-8cc9-1f7c766d6bdb None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:26.062030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce299-78ee-4d10-8cc9-1f7c766d6bdb None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:26.095477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d25924-b6da-4b34-b9cf-033ee9ceba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:26.096013 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d25924-b6da-4b34-b9cf-033ee9ceba86 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:26.096286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d25924-b6da-4b34-b9cf-033ee9ceba86 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:26.096556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d25924-b6da-4b34-b9cf-033ee9ceba86 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:26.097169 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d25924-b6da-4b34-b9cf-033ee9ceba86 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:26.097467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d25924-b6da-4b34-b9cf-033ee9ceba86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:26.098812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d25924-b6da-4b34-b9cf-033ee9ceba86 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:26.103727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 490/976] 10.222.0.23 () {56 vars in 1116 bytes} [Fri Oct 21 21:11:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:26.109758 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa925a7-b2ab-457d-a3e9-10bd7cd7be35 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:26.207017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa925a7-b2ab-457d-a3e9-10bd7cd7be35 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:26.239373 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65704061-b6c9-4929-9c83-bb19f550da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:26.239966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704061-b6c9-4929-9c83-bb19f550da00 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:26.240241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704061-b6c9-4929-9c83-bb19f550da00 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:26.240510 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704061-b6c9-4929-9c83-bb19f550da00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:26.241194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65704061-b6c9-4929-9c83-bb19f550da00 None admin] RBAC: Adding query filter params (interface=public, service_id=d130c3137518413eb8b515d260d94edb, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:26.241499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65704061-b6c9-4929-9c83-bb19f550da00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:26.242840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65704061-b6c9-4929-9c83-bb19f550da00 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:26.247653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 487/977] 10.222.0.23 () {56 vars in 1251 bytes} [Fri Oct 21 21:11:26 2022] GET /identity/v3/endpoints?service_id=d130c3137518413eb8b515d260d94edb&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:26.253249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d25924-b6da-4b34-b9cf-033ee9ceba86 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:26.256985 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:26.349683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d25924-b6da-4b34-b9cf-033ee9ceba86 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:26.382181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebbbe7-27d6-4b54-ab9b-b3d9304d011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:26.382776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebbbe7-27d6-4b54-ab9b-b3d9304d011a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:26.383055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebbbe7-27d6-4b54-ab9b-b3d9304d011a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:26.383350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebbbe7-27d6-4b54-ab9b-b3d9304d011a None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:26.383947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebbbe7-27d6-4b54-ab9b-b3d9304d011a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:26.385282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebbbe7-27d6-4b54-ab9b-b3d9304d011a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:26.392434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 491/978] 10.222.0.23 () {56 vars in 1087 bytes} [Fri Oct 21 21:11:26 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:11:28.489701 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893c94-3091-4314-81b7-1a81d6c875a0 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:28.490240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893c94-3091-4314-81b7-1a81d6c875a0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:28.490240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893c94-3091-4314-81b7-1a81d6c875a0 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:28.491595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 488/979] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:11:28.496620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65714a0-403e-4525-9557-577676f9da2d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:28.497037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65714a0-403e-4525-9557-577676f9da2d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:28.497166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65714a0-403e-4525-9557-577676f9da2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:28.515110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d65714a0-403e-4525-9557-577676f9da2d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:11:28.516299 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d65714a0-403e-4525-9557-577676f9da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:11:28.574698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:28.580825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 492/980] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:11:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 21 21:11:28.857377 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44893c94-3091-4314-81b7-1a81d6c875a0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:28.876821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:28.956708 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44893c94-3091-4314-81b7-1a81d6c875a0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:28.988554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb908295-8c62-451a-9860-70bd708d9658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:28.989159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb908295-8c62-451a-9860-70bd708d9658 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:28.989434 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb908295-8c62-451a-9860-70bd708d9658 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:28.989703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb908295-8c62-451a-9860-70bd708d9658 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:28.990266 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb908295-8c62-451a-9860-70bd708d9658 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:28.991620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb908295-8c62-451a-9860-70bd708d9658 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-eb908295-8c62-451a-9860-70bd708d9658 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 21 21:11:29.000671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 21 21:11:29.001832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 21 21:11:29.002670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 489/981] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Oct 21 21:11:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 21 21:11:29.007637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65714a0-403e-4525-9557-577676f9da2d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:29.101955 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65714a0-403e-4525-9557-577676f9da2d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:29.134798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da8c6f-14ff-4dd9-adf3-633b0bdca5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:29.135355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da8c6f-14ff-4dd9-adf3-633b0bdca5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:29.135632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da8c6f-14ff-4dd9-adf3-633b0bdca5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:29.135901 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da8c6f-14ff-4dd9-adf3-633b0bdca5a3 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:29.136517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da8c6f-14ff-4dd9-adf3-633b0bdca5a3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:11:29.136813 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da8c6f-14ff-4dd9-adf3-633b0bdca5a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:29.138172 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da8c6f-14ff-4dd9-adf3-633b0bdca5a3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:29.143035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 493/982] 10.222.0.23 () {56 vars in 1116 bytes} [Fri Oct 21 21:11:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:11:29.148878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb908295-8c62-451a-9860-70bd708d9658 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:11:29.228364 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:29.246860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb908295-8c62-451a-9860-70bd708d9658 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:11:29.279955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99932ccd-9267-4805-8255-90ea244e071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:11:29.280547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99932ccd-9267-4805-8255-90ea244e071b None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:11:29.280827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99932ccd-9267-4805-8255-90ea244e071b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:11:29.281100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99932ccd-9267-4805-8255-90ea244e071b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:11:29.281765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99932ccd-9267-4805-8255-90ea244e071b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:11:29.283123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99932ccd-9267-4805-8255-90ea244e071b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:11:29.302384 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 490/983] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:11:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:11:39.140221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=69 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:11:39.298852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:32.659999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95630c22-30f9-416d-96d1-981c4aead982 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:32.660464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95630c22-30f9-416d-96d1-981c4aead982 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:32.660541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95630c22-30f9-416d-96d1-981c4aead982 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:32.665744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 494/984] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:12:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:32.668783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45921-a343-455b-a29c-a2b6574c035b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:32.669721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45921-a343-455b-a29c-a2b6574c035b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:32.670183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45921-a343-455b-a29c-a2b6574c035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:32.769415 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-26a45921-a343-455b-a29c-a2b6574c035b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:32.771664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-26a45921-a343-455b-a29c-a2b6574c035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:32.882887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 491/985] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:12:33.184474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9be3e-74b0-47a0-aa4e-d6e85667729d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:33.184850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9be3e-74b0-47a0-aa4e-d6e85667729d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:33.185038 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9be3e-74b0-47a0-aa4e-d6e85667729d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:33.186562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 495/986] 10.222.0.23 () {54 vars in 964 bytes} [Fri Oct 21 21:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:33.192990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f9ee-c5dd-46fa-9c47-0eab51a53ef2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:33.193663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f9ee-c5dd-46fa-9c47-0eab51a53ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:33.194009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f9ee-c5dd-46fa-9c47-0eab51a53ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:33.279557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8a30f9ee-c5dd-46fa-9c47-0eab51a53ef2 None None] MFA Rules not processed for user `ad7ef5b260e4425c93ebbe85570136db`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:33.280789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8a30f9ee-c5dd-46fa-9c47-0eab51a53ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:33.302409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:33.360710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 492/987] 10.222.0.23 () {58 vars in 1061 bytes} [Fri Oct 21 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:12:33.369585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9be3e-74b0-47a0-aa4e-d6e85667729d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:12:33.371450 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1bb9be3e-74b0-47a0-aa4e-d6e85667729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:33.490524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9be3e-74b0-47a0-aa4e-d6e85667729d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:12:33.572048 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003baf3-4be8-45d8-af81-18954ee7d88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:12:33.572923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003baf3-4be8-45d8-af81-18954ee7d88d service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:33.573202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003baf3-4be8-45d8-af81-18954ee7d88d service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:33.573471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003baf3-4be8-45d8-af81-18954ee7d88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:33.575624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5003baf3-4be8-45d8-af81-18954ee7d88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:33.632295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:33.691356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003baf3-4be8-45d8-af81-18954ee7d88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:12:33.692862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003baf3-4be8-45d8-af81-18954ee7d88d service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:12:33.712757 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 496/988] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:12:36.163530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a360f-9c1e-485a-842b-000dfc6f1899 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:36.164056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a360f-9c1e-485a-842b-000dfc6f1899 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:36.164056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a360f-9c1e-485a-842b-000dfc6f1899 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:36.165343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 493/989] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:36.170455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36689240-7e6c-428b-8de5-eeff5ac7fad9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:36.170820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36689240-7e6c-428b-8de5-eeff5ac7fad9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:36.171009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36689240-7e6c-428b-8de5-eeff5ac7fad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:36.252267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-36689240-7e6c-428b-8de5-eeff5ac7fad9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:36.253502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-36689240-7e6c-428b-8de5-eeff5ac7fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:36.347670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 497/990] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:12:36.633889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a360f-9c1e-485a-842b-000dfc6f1899 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:12:36.635448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-456a360f-9c1e-485a-842b-000dfc6f1899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:36.739245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a360f-9c1e-485a-842b-000dfc6f1899 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:12:36.810583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:36.812776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdeca9-536e-4508-a8a1-bc842d4dddb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:12:36.813421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdeca9-536e-4508-a8a1-bc842d4dddb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:36.813780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdeca9-536e-4508-a8a1-bc842d4dddb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:36.814092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdeca9-536e-4508-a8a1-bc842d4dddb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:36.816404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3cfdeca9-536e-4508-a8a1-bc842d4dddb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:36.924415 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdeca9-536e-4508-a8a1-bc842d4dddb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:12:36.926215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdeca9-536e-4508-a8a1-bc842d4dddb6 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:12:36.944325 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 494/991] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:12:39.388008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cb2f1-b8dc-402f-8795-b0660df00d4e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:39.388549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cb2f1-b8dc-402f-8795-b0660df00d4e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:39.388549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cb2f1-b8dc-402f-8795-b0660df00d4e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:39.389826 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 498/992] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:39.394917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d6d06-80d1-41ed-a0cf-7c713bea9349 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:39.395356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d6d06-80d1-41ed-a0cf-7c713bea9349 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:39.395505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d6d06-80d1-41ed-a0cf-7c713bea9349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:39.461984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2d0d6d06-80d1-41ed-a0cf-7c713bea9349 None None] MFA Rules not processed for user `78bf1c78c35546668f4dd2fc9ca541d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:39.463171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2d0d6d06-80d1-41ed-a0cf-7c713bea9349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:39.513743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:39.557347 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 495/993] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:12:39.840880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cb2f1-b8dc-402f-8795-b0660df00d4e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:12:39.842438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1b6cb2f1-b8dc-402f-8795-b0660df00d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:39.852783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:39.946954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cb2f1-b8dc-402f-8795-b0660df00d4e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:12:40.019796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e904e1-d4b5-48f5-8ce1-780648a849c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:12:40.020395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e904e1-d4b5-48f5-8ce1-780648a849c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:40.020672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e904e1-d4b5-48f5-8ce1-780648a849c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:40.020940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e904e1-d4b5-48f5-8ce1-780648a849c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:40.022503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-44e904e1-d4b5-48f5-8ce1-780648a849c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:40.083888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:40.128750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e904e1-d4b5-48f5-8ce1-780648a849c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:12:40.130168 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e904e1-d4b5-48f5-8ce1-780648a849c4 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:12:40.147975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 499/994] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:12:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:12:42.798207 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9c5b8-c2fe-4967-a45c-deaca6d0063e None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:42.798742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9c5b8-c2fe-4967-a45c-deaca6d0063e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:42.798742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9c5b8-c2fe-4967-a45c-deaca6d0063e None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:42.800147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 496/995] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:42.805224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7323-ae67-41e1-b653-f7131f66c902 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:42.805633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7323-ae67-41e1-b653-f7131f66c902 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:42.805761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7323-ae67-41e1-b653-f7131f66c902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:42.871347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-97fa7323-ae67-41e1-b653-f7131f66c902 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:42.872554 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-97fa7323-ae67-41e1-b653-f7131f66c902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:42.970075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 500/996] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:12:43.252956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9c5b8-c2fe-4967-a45c-deaca6d0063e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:12:43.254492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1cc9c5b8-c2fe-4967-a45c-deaca6d0063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:43.356594 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9c5b8-c2fe-4967-a45c-deaca6d0063e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:12:43.427093 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1762b-d30f-41dc-bd15-c4dad61c91de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:12:43.427730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1762b-d30f-41dc-bd15-c4dad61c91de service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:43.428011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1762b-d30f-41dc-bd15-c4dad61c91de service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:43.428278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1762b-d30f-41dc-bd15-c4dad61c91de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:43.429842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-eaf1762b-d30f-41dc-bd15-c4dad61c91de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:43.436896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:43.537469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1762b-d30f-41dc-bd15-c4dad61c91de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:12:43.538921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1762b-d30f-41dc-bd15-c4dad61c91de service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:12:43.556406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 497/997] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:12:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:12:46.342184 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42fb8-4611-47cb-839e-1234503d5fd9 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:46.342739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42fb8-4611-47cb-839e-1234503d5fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:46.342739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c42fb8-4611-47cb-839e-1234503d5fd9 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:46.344124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 501/998] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:46.349267 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e5686-bffc-47f7-a050-d697612f20bc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:46.349666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e5686-bffc-47f7-a050-d697612f20bc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:46.349820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e5686-bffc-47f7-a050-d697612f20bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:46.420137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d91e5686-bffc-47f7-a050-d697612f20bc None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:46.421388 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d91e5686-bffc-47f7-a050-d697612f20bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:46.486137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:46.529079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 498/999] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:12:46.805836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c42fb8-4611-47cb-839e-1234503d5fd9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:12:46.807367 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-67c42fb8-4611-47cb-839e-1234503d5fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:46.828514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:46.911321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c42fb8-4611-47cb-839e-1234503d5fd9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:12:46.985320 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a6ad9-3101-4ac4-bb58-11a1295e068d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:12:46.985924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6ad9-3101-4ac4-bb58-11a1295e068d service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:46.986208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6ad9-3101-4ac4-bb58-11a1295e068d service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:46.986479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6ad9-3101-4ac4-bb58-11a1295e068d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:46.988094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f01a6ad9-3101-4ac4-bb58-11a1295e068d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:47.061318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:47.100107 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a6ad9-3101-4ac4-bb58-11a1295e068d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:12:47.101536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a6ad9-3101-4ac4-bb58-11a1295e068d service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:12:47.119886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 502/1000] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:12:49.292489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d1ae-f04f-4a07-ad1b-0b3af0cb6ce2 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:49.293043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d1ae-f04f-4a07-ad1b-0b3af0cb6ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:49.293043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d1ae-f04f-4a07-ad1b-0b3af0cb6ce2 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:49.295290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 499/1001] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:49.300175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2904b09-5300-47e0-aa7f-685dd3508d88 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:49.300795 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2904b09-5300-47e0-aa7f-685dd3508d88 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:49.301125 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2904b09-5300-47e0-aa7f-685dd3508d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:49.367628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b2904b09-5300-47e0-aa7f-685dd3508d88 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:49.368738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b2904b09-5300-47e0-aa7f-685dd3508d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:49.475294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 503/1002] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:12:49.763877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e29b-9ddf-4f9b-9504-e99ae1ebd9e7 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:49.764263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e29b-9ddf-4f9b-9504-e99ae1ebd9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:49.764603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e29b-9ddf-4f9b-9504-e99ae1ebd9e7 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:49.766063 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 500/1003] 10.222.0.23 () {54 vars in 964 bytes} [Fri Oct 21 21:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:49.772293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf9d54-8081-4f9a-b5cb-0985ee45705e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:49.772586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf9d54-8081-4f9a-b5cb-0985ee45705e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:49.772879 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf9d54-8081-4f9a-b5cb-0985ee45705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:49.805774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:49.850682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b1cf9d54-8081-4f9a-b5cb-0985ee45705e None None] MFA Rules not processed for user `ad7ef5b260e4425c93ebbe85570136db`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:49.851913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b1cf9d54-8081-4f9a-b5cb-0985ee45705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:49.928092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 504/1004] 10.222.0.23 () {58 vars in 1061 bytes} [Fri Oct 21 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:12:49.936987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73e29b-9ddf-4f9b-9504-e99ae1ebd9e7 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:12:49.938522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-eb73e29b-9ddf-4f9b-9504-e99ae1ebd9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:50.042072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73e29b-9ddf-4f9b-9504-e99ae1ebd9e7 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:12:50.117333 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432ee74-9160-42e3-92a4-50855d0d6ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:12:50.117944 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432ee74-9160-42e3-92a4-50855d0d6ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:50.118223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432ee74-9160-42e3-92a4-50855d0d6ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:50.118496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432ee74-9160-42e3-92a4-50855d0d6ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:50.120147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e432ee74-9160-42e3-92a4-50855d0d6ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:50.137227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:50.229959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432ee74-9160-42e3-92a4-50855d0d6ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:12:50.231423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432ee74-9160-42e3-92a4-50855d0d6ef8 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:12:50.249433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 501/1005] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:12:52.675505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd177a-a1c9-4327-b9b7-bc6518758749 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:52.675950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd177a-a1c9-4327-b9b7-bc6518758749 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:52.676092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd177a-a1c9-4327-b9b7-bc6518758749 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:52.677415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 505/1006] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:52.683624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede29ea-21c4-472c-a710-fe98067e28b0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:52.684106 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede29ea-21c4-472c-a710-fe98067e28b0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:52.684197 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede29ea-21c4-472c-a710-fe98067e28b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:52.755089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7ede29ea-21c4-472c-a710-fe98067e28b0 None None] MFA Rules not processed for user `78bf1c78c35546668f4dd2fc9ca541d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:52.756379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7ede29ea-21c4-472c-a710-fe98067e28b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:52.824601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:52.860849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 502/1007] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:12:53.143909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd177a-a1c9-4327-b9b7-bc6518758749 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:12:53.145498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9dbd177a-a1c9-4327-b9b7-bc6518758749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:53.253389 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd177a-a1c9-4327-b9b7-bc6518758749 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:12:53.273313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:53.329361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bf181-f60f-429b-baf9-3c7943548c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:12:53.329886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bf181-f60f-429b-baf9-3c7943548c17 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:53.330165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bf181-f60f-429b-baf9-3c7943548c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:53.330435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bf181-f60f-429b-baf9-3c7943548c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:53.332066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-cb9bf181-f60f-429b-baf9-3c7943548c17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:53.445514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bf181-f60f-429b-baf9-3c7943548c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:12:53.446943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bf181-f60f-429b-baf9-3c7943548c17 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:12:53.465997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 506/1008] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:12:55.856795 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c78a4a-e6c8-4ba1-ad75-79497701cd82 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:55.857244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c78a4a-e6c8-4ba1-ad75-79497701cd82 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:55.857335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c78a4a-e6c8-4ba1-ad75-79497701cd82 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:55.858692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 503/1009] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:55.863853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cd3d9-382e-4970-b792-9d5ac9c4d521 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:55.864277 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cd3d9-382e-4970-b792-9d5ac9c4d521 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:55.864404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cd3d9-382e-4970-b792-9d5ac9c4d521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:55.926971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:55.929745 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-181cd3d9-382e-4970-b792-9d5ac9c4d521 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:55.931557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-181cd3d9-382e-4970-b792-9d5ac9c4d521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:56.025295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 507/1010] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:12:56.304674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c78a4a-e6c8-4ba1-ad75-79497701cd82 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:12:56.306193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-91c78a4a-e6c8-4ba1-ad75-79497701cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:56.408156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c78a4a-e6c8-4ba1-ad75-79497701cd82 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:12:56.478845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836d401-f559-4f41-9737-3673c63caf8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:12:56.479485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836d401-f559-4f41-9737-3673c63caf8c service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:56.479782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836d401-f559-4f41-9737-3673c63caf8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:56.480050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836d401-f559-4f41-9737-3673c63caf8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:56.481610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b836d401-f559-4f41-9737-3673c63caf8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:56.508143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:56.588615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836d401-f559-4f41-9737-3673c63caf8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:12:56.589955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836d401-f559-4f41-9737-3673c63caf8c service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:12:56.607155 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 504/1011] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:12:58.782916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a09082-ad64-483f-a027-1d2628c72986 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:58.783504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a09082-ad64-483f-a027-1d2628c72986 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:58.783605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a09082-ad64-483f-a027-1d2628c72986 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:58.784893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 508/1012] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:12:58.790145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78611019-52d2-46db-bbc9-455ceeecb43d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:58.790565 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78611019-52d2-46db-bbc9-455ceeecb43d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:58.790729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78611019-52d2-46db-bbc9-455ceeecb43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:58.856613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-78611019-52d2-46db-bbc9-455ceeecb43d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:12:58.857829 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-78611019-52d2-46db-bbc9-455ceeecb43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:58.932816 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:58.955052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 505/1013] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:12:59.244948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a09082-ad64-483f-a027-1d2628c72986 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:12:59.246472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a0a09082-ad64-483f-a027-1d2628c72986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:59.348999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a09082-ad64-483f-a027-1d2628c72986 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:12:59.377304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:12:59.421360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66b741-d8cd-4df4-b03b-689f48e33aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:12:59.421963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66b741-d8cd-4df4-b03b-689f48e33aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:12:59.422248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66b741-d8cd-4df4-b03b-689f48e33aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:12:59.422519 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66b741-d8cd-4df4-b03b-689f48e33aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:12:59.424132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1c66b741-d8cd-4df4-b03b-689f48e33aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:12:59.530213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66b741-d8cd-4df4-b03b-689f48e33aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:12:59.531711 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66b741-d8cd-4df4-b03b-689f48e33aa6 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:12:59.549176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 509/1014] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:01.996644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dd8ca-c250-47b3-b11c-223994f92cb3 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:01.997189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dd8ca-c250-47b3-b11c-223994f92cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:01.997189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dd8ca-c250-47b3-b11c-223994f92cb3 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:01.998537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 506/1015] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:02.003746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb983f6-f88a-41b0-8f41-c21c8502b571 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:02.004144 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb983f6-f88a-41b0-8f41-c21c8502b571 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:02.004293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb983f6-f88a-41b0-8f41-c21c8502b571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:02.069303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-feb983f6-f88a-41b0-8f41-c21c8502b571 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:02.070503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-feb983f6-f88a-41b0-8f41-c21c8502b571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:02.078774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:02.163498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 510/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:02.447936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dd8ca-c250-47b3-b11c-223994f92cb3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:02.449508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a43dd8ca-c250-47b3-b11c-223994f92cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:02.551808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dd8ca-c250-47b3-b11c-223994f92cb3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:02.623130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a771844-f46b-44b6-bdae-6d6405d4c38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:02.623761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a771844-f46b-44b6-bdae-6d6405d4c38c service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:02.624038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a771844-f46b-44b6-bdae-6d6405d4c38c service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:02.624309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a771844-f46b-44b6-bdae-6d6405d4c38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:02.625871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2a771844-f46b-44b6-bdae-6d6405d4c38c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:02.660633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:02.736798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a771844-f46b-44b6-bdae-6d6405d4c38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:02.738223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a771844-f46b-44b6-bdae-6d6405d4c38c service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:02.755931 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 507/1017] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:06.796893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36853f-22a1-42f6-b8cd-07aa6889041b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:06.797404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36853f-22a1-42f6-b8cd-07aa6889041b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:06.797404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36853f-22a1-42f6-b8cd-07aa6889041b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:06.798721 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 511/1018] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:06.803896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff95864-5c4d-4c09-b202-6f2cee8fcf35 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:06.804289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff95864-5c4d-4c09-b202-6f2cee8fcf35 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:06.804453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff95864-5c4d-4c09-b202-6f2cee8fcf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:06.871531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2ff95864-5c4d-4c09-b202-6f2cee8fcf35 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:06.872656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2ff95864-5c4d-4c09-b202-6f2cee8fcf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:06.958139 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:06.970390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 508/1019] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:07.256871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36853f-22a1-42f6-b8cd-07aa6889041b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:07.258502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8d36853f-22a1-42f6-b8cd-07aa6889041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:07.362330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36853f-22a1-42f6-b8cd-07aa6889041b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:07.401317 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:07.437128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9badaa-b7ea-4d78-8c85-3ae568982f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:07.437738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9badaa-b7ea-4d78-8c85-3ae568982f4f service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:07.438018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9badaa-b7ea-4d78-8c85-3ae568982f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:07.438293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9badaa-b7ea-4d78-8c85-3ae568982f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:07.439916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4c9badaa-b7ea-4d78-8c85-3ae568982f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:07.548087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9badaa-b7ea-4d78-8c85-3ae568982f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:07.549513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9badaa-b7ea-4d78-8c85-3ae568982f4f service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:07.567757 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 512/1020] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:13:10.347682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feffac-77a8-403f-aab9-2009e419023d None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:10.348235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feffac-77a8-403f-aab9-2009e419023d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:10.348235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feffac-77a8-403f-aab9-2009e419023d None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:10.349734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 509/1021] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:10.354690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3b7ed-f332-4eaa-8b18-d176a26b1b41 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:10.355087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3b7ed-f332-4eaa-8b18-d176a26b1b41 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:10.355239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3b7ed-f332-4eaa-8b18-d176a26b1b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:10.420175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6db3b7ed-f332-4eaa-8b18-d176a26b1b41 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:10.421435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6db3b7ed-f332-4eaa-8b18-d176a26b1b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:10.439097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:10.519944 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 513/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:10.801455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feffac-77a8-403f-aab9-2009e419023d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:10.803163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0feffac-77a8-403f-aab9-2009e419023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:10.915530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feffac-77a8-403f-aab9-2009e419023d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:10.989601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453ae4a-2229-4c71-bf1a-40dc1ba149bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:10.990130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453ae4a-2229-4c71-bf1a-40dc1ba149bd service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:10.990431 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453ae4a-2229-4c71-bf1a-40dc1ba149bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:10.990700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453ae4a-2229-4c71-bf1a-40dc1ba149bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:10.992340 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e453ae4a-2229-4c71-bf1a-40dc1ba149bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:11.037610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:11.106346 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453ae4a-2229-4c71-bf1a-40dc1ba149bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:11.107803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453ae4a-2229-4c71-bf1a-40dc1ba149bd service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:11.126436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 510/1023] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:15.211563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac6cd-daf8-41fb-b905-d35fd429423b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:15.212061 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac6cd-daf8-41fb-b905-d35fd429423b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:15.212150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac6cd-daf8-41fb-b905-d35fd429423b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:15.214005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 514/1024] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:15.219094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cd53b-57a2-47a7-a7d0-947a43d5140c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:15.219513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cd53b-57a2-47a7-a7d0-947a43d5140c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:15.219682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cd53b-57a2-47a7-a7d0-947a43d5140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:15.287326 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-870cd53b-57a2-47a7-a7d0-947a43d5140c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:15.288559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-870cd53b-57a2-47a7-a7d0-947a43d5140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:15.385473 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:15.388098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 511/1025] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:15.664266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac6cd-daf8-41fb-b905-d35fd429423b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:15.665794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-70dac6cd-daf8-41fb-b905-d35fd429423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:15.767883 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac6cd-daf8-41fb-b905-d35fd429423b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:15.816758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:15.842860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef747-40b6-4091-bc29-14731f9f9e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:15.843495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef747-40b6-4091-bc29-14731f9f9e24 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:15.843791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef747-40b6-4091-bc29-14731f9f9e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:15.844030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef747-40b6-4091-bc29-14731f9f9e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:15.845590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-761ef747-40b6-4091-bc29-14731f9f9e24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:15.964398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ef747-40b6-4091-bc29-14731f9f9e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:15.965818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ef747-40b6-4091-bc29-14731f9f9e24 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:15.983896 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 515/1026] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:20.894288 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5e07c-f70b-4919-88fa-c9835946a41b None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:20.895358 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5e07c-f70b-4919-88fa-c9835946a41b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:20.895918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5e07c-f70b-4919-88fa-c9835946a41b None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:20.897783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 512/1027] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:20.903895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bbdb5-35ff-4fbc-9d92-c161e76fba55 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:20.903895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bbdb5-35ff-4fbc-9d92-c161e76fba55 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:20.912630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bbdb5-35ff-4fbc-9d92-c161e76fba55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:21.030838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-414bbdb5-35ff-4fbc-9d92-c161e76fba55 None None] MFA Rules not processed for user `aa89e84c708f44c299c728284e33fabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:21.032052 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-414bbdb5-35ff-4fbc-9d92-c161e76fba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:21.068612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:21.167802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 516/1028] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:25.232022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449ac7-918a-47ba-a984-7558e4f7abaa None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:25.232611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449ac7-918a-47ba-a984-7558e4f7abaa None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:25.232611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449ac7-918a-47ba-a984-7558e4f7abaa None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:25.234049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 513/1029] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:25.239285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31191fd-9201-4f8a-b9fc-7cbc06ae2149 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:25.239739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31191fd-9201-4f8a-b9fc-7cbc06ae2149 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:25.239867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31191fd-9201-4f8a-b9fc-7cbc06ae2149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:25.323445 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d31191fd-9201-4f8a-b9fc-7cbc06ae2149 None None] MFA Rules not processed for user `aa89e84c708f44c299c728284e33fabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:25.324581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d31191fd-9201-4f8a-b9fc-7cbc06ae2149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:25.401100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:25.439527 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 517/1030] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:26.854494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f11c7-3e36-419e-bb3b-f845881fe162 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:26.855041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f11c7-3e36-419e-bb3b-f845881fe162 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:26.855041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f11c7-3e36-419e-bb3b-f845881fe162 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:26.856442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 514/1031] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:26.861489 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2a7c-b2cb-4bac-8932-697959b4dcd9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:26.861933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2a7c-b2cb-4bac-8932-697959b4dcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:26.862028 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2a7c-b2cb-4bac-8932-697959b4dcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:26.937567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-040e2a7c-b2cb-4bac-8932-697959b4dcd9 None None] MFA Rules not processed for user `aa89e84c708f44c299c728284e33fabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:26.938759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-040e2a7c-b2cb-4bac-8932-697959b4dcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:27.045999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 518/1032] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:30.514044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a94f0-0995-43fa-ad09-be55fee3057f None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:30.514942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a94f0-0995-43fa-ad09-be55fee3057f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:30.515380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a94f0-0995-43fa-ad09-be55fee3057f None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:30.516954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 515/1033] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:30.522496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510901-9a35-4788-b404-2d410f158e03 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:30.522944 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510901-9a35-4788-b404-2d410f158e03 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:30.523058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510901-9a35-4788-b404-2d410f158e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:30.561295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:30.595674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-97510901-9a35-4788-b404-2d410f158e03 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:30.596799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-97510901-9a35-4788-b404-2d410f158e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:30.697969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 519/1034] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:30.999186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f04ec-cc4f-4b83-8b54-e699f0898936 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:30.999690 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f04ec-cc4f-4b83-8b54-e699f0898936 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:31.000075 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f04ec-cc4f-4b83-8b54-e699f0898936 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:31.001516 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 516/1035] 10.222.0.23 () {54 vars in 961 bytes} [Fri Oct 21 21:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:31.018694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171eba7-1487-4455-9896-56ff81e7f2d6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:31.018973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171eba7-1487-4455-9896-56ff81e7f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:31.019253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171eba7-1487-4455-9896-56ff81e7f2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:31.111064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0171eba7-1487-4455-9896-56ff81e7f2d6 None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:31.112291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0171eba7-1487-4455-9896-56ff81e7f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:31.162565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:31.242309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 520/1036] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Oct 21 21:13:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:31.250615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f04ec-cc4f-4b83-8b54-e699f0898936 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:31.252244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fd0f04ec-cc4f-4b83-8b54-e699f0898936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:31.408179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f04ec-cc4f-4b83-8b54-e699f0898936 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:31.488335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:31.531878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58c7a5-3f75-46d2-ab07-cb8f6a5beb95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:31.532532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58c7a5-3f75-46d2-ab07-cb8f6a5beb95 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:31.532780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58c7a5-3f75-46d2-ab07-cb8f6a5beb95 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:31.533034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58c7a5-3f75-46d2-ab07-cb8f6a5beb95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:31.534593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-eb58c7a5-3f75-46d2-ab07-cb8f6a5beb95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:31.644049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58c7a5-3f75-46d2-ab07-cb8f6a5beb95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:31.645655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58c7a5-3f75-46d2-ab07-cb8f6a5beb95 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:31.665864 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 517/1037] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:34.043240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c137263-b07b-49e6-9afb-7d30536ca9de None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:34.043920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c137263-b07b-49e6-9afb-7d30536ca9de None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:34.043920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c137263-b07b-49e6-9afb-7d30536ca9de None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:34.060292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 521/1038] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:34.060666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1010ed6-de18-46b7-ac7a-3bcf7ce3b494 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:34.060666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1010ed6-de18-46b7-ac7a-3bcf7ce3b494 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:34.060666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1010ed6-de18-46b7-ac7a-3bcf7ce3b494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:34.120002 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b1010ed6-de18-46b7-ac7a-3bcf7ce3b494 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:34.121185 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b1010ed6-de18-46b7-ac7a-3bcf7ce3b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:34.161612 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:34.234720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 518/1039] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:34.522679 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c137263-b07b-49e6-9afb-7d30536ca9de None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:34.525084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6c137263-b07b-49e6-9afb-7d30536ca9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:34.700684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c137263-b07b-49e6-9afb-7d30536ca9de None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:34.713522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:34.834409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88d363-e875-4b4e-a763-2ee7b0db9635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:34.835017 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88d363-e875-4b4e-a763-2ee7b0db9635 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:34.835321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88d363-e875-4b4e-a763-2ee7b0db9635 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:34.835602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88d363-e875-4b4e-a763-2ee7b0db9635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:34.837226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0d88d363-e875-4b4e-a763-2ee7b0db9635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:34.928045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88d363-e875-4b4e-a763-2ee7b0db9635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:34.929633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88d363-e875-4b4e-a763-2ee7b0db9635 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:34.948522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 522/1040] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:37.413207 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e683ca-a01f-4e8a-8b7e-64aded36da8e None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:37.413728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e683ca-a01f-4e8a-8b7e-64aded36da8e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:37.413728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e683ca-a01f-4e8a-8b7e-64aded36da8e None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:37.415070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 519/1041] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:37.420447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bffba3-1379-4f76-97de-d3b4cb48def8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:37.420845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bffba3-1379-4f76-97de-d3b4cb48def8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:37.420991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bffba3-1379-4f76-97de-d3b4cb48def8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:37.437247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:37.495720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-62bffba3-1379-4f76-97de-d3b4cb48def8 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:37.497284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-62bffba3-1379-4f76-97de-d3b4cb48def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:37.605486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 523/1042] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:37.893518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bea41-ea3f-474b-a6ff-83f01b19b7e6 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:37.893914 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bea41-ea3f-474b-a6ff-83f01b19b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:37.894285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bea41-ea3f-474b-a6ff-83f01b19b7e6 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:37.896078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 520/1043] 10.222.0.23 () {54 vars in 961 bytes} [Fri Oct 21 21:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:37.901605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca4408-3a7b-4c44-a6b1-ff15cf378dba None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:37.902015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca4408-3a7b-4c44-a6b1-ff15cf378dba None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:37.902382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca4408-3a7b-4c44-a6b1-ff15cf378dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:37.984647 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e3ca4408-3a7b-4c44-a6b1-ff15cf378dba None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:37.985983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e3ca4408-3a7b-4c44-a6b1-ff15cf378dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:38.024945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:38.120875 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 524/1044] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Oct 21 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:38.129073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bea41-ea3f-474b-a6ff-83f01b19b7e6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:38.131247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b89bea41-ea3f-474b-a6ff-83f01b19b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:38.293654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bea41-ea3f-474b-a6ff-83f01b19b7e6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:38.316561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:38.413226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb25e6-f395-453a-80b3-cad71c2106c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:38.413854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb25e6-f395-453a-80b3-cad71c2106c3 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:38.414012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb25e6-f395-453a-80b3-cad71c2106c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:38.414284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb25e6-f395-453a-80b3-cad71c2106c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:38.415923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dfdb25e6-f395-453a-80b3-cad71c2106c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:38.514323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb25e6-f395-453a-80b3-cad71c2106c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:38.515986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb25e6-f395-453a-80b3-cad71c2106c3 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:38.536471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 521/1045] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:38.614622 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eed0d-afb6-4588-916a-34c6a8898485 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:38.615161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eed0d-afb6-4588-916a-34c6a8898485 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:38.615161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eed0d-afb6-4588-916a-34c6a8898485 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:38.616717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 525/1046] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:38.622791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dc727-9cf2-4ccb-87cf-4a51ee5be081 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:38.623179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dc727-9cf2-4ccb-87cf-4a51ee5be081 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:38.623555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dc727-9cf2-4ccb-87cf-4a51ee5be081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:38.659335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:38.705267 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8a7dc727-9cf2-4ccb-87cf-4a51ee5be081 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:38.706734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8a7dc727-9cf2-4ccb-87cf-4a51ee5be081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:38.839323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 522/1047] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:39.171078 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406834d7-38d3-4e16-b50b-f01b6150d5de None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:39.171234 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406834d7-38d3-4e16-b50b-f01b6150d5de None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:39.171585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406834d7-38d3-4e16-b50b-f01b6150d5de None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:39.173185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 526/1048] 10.222.0.23 () {54 vars in 963 bytes} [Fri Oct 21 21:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:39.178054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681d5d-b7cc-412f-98a1-816218610194 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:39.178407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681d5d-b7cc-412f-98a1-816218610194 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:39.178761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681d5d-b7cc-412f-98a1-816218610194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:39.265765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-64681d5d-b7cc-412f-98a1-816218610194 None None] MFA Rules not processed for user `31f812676e6f4b258f556d5a0b54dc46`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:39.266981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-64681d5d-b7cc-412f-98a1-816218610194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:39.317829 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:39.350224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 523/1049] 10.222.0.23 () {58 vars in 1060 bytes} [Fri Oct 21 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:39.358375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406834d7-38d3-4e16-b50b-f01b6150d5de None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:39.360113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-406834d7-38d3-4e16-b50b-f01b6150d5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:39.470674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406834d7-38d3-4e16-b50b-f01b6150d5de None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:39.521266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:39.560493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bca12-60cb-49a6-ae10-0f36786060b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:39.561083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bca12-60cb-49a6-ae10-0f36786060b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:39.561546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bca12-60cb-49a6-ae10-0f36786060b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:39.561866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bca12-60cb-49a6-ae10-0f36786060b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:39.563446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8f3bca12-60cb-49a6-ae10-0f36786060b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:39.699923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bca12-60cb-49a6-ae10-0f36786060b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:39.701421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bca12-60cb-49a6-ae10-0f36786060b1 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:39.727356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 527/1050] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:40.790436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711506d0-c30b-48c8-98bd-05788b54c011 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:40.790975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711506d0-c30b-48c8-98bd-05788b54c011 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:40.790975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711506d0-c30b-48c8-98bd-05788b54c011 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:40.792368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 524/1051] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:40.797611 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db1bc-fb48-482a-b123-02aecaf8f0f6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:40.798077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db1bc-fb48-482a-b123-02aecaf8f0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:40.798186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db1bc-fb48-482a-b123-02aecaf8f0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:40.863695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-755db1bc-fb48-482a-b123-02aecaf8f0f6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:40.864883 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-755db1bc-fb48-482a-b123-02aecaf8f0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:40.886470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:40.964018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 528/1052] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:41.254164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711506d0-c30b-48c8-98bd-05788b54c011 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:41.255804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-711506d0-c30b-48c8-98bd-05788b54c011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:41.409935 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711506d0-c30b-48c8-98bd-05788b54c011 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:41.464282 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:41.527530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07286b73-2995-46ed-8c6b-bee7a3698718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:41.528066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07286b73-2995-46ed-8c6b-bee7a3698718 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:41.528183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07286b73-2995-46ed-8c6b-bee7a3698718 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:41.528355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07286b73-2995-46ed-8c6b-bee7a3698718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:41.529936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-07286b73-2995-46ed-8c6b-bee7a3698718 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:41.629606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07286b73-2995-46ed-8c6b-bee7a3698718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:41.631196 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07286b73-2995-46ed-8c6b-bee7a3698718 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:41.650456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 525/1053] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:43.853253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265f4ee-cd14-4310-bb60-b3e1a62e9405 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:43.853817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265f4ee-cd14-4310-bb60-b3e1a62e9405 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:43.853817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265f4ee-cd14-4310-bb60-b3e1a62e9405 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:43.855310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 529/1054] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:43.860402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d413cb-db10-4a5c-ab02-907e8130dce9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:43.860806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d413cb-db10-4a5c-ab02-907e8130dce9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:43.860986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d413cb-db10-4a5c-ab02-907e8130dce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:43.935018 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-76d413cb-db10-4a5c-ab02-907e8130dce9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:43.936263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-76d413cb-db10-4a5c-ab02-907e8130dce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:43.944216 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:44.041695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 526/1055] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:44.329947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265f4ee-cd14-4310-bb60-b3e1a62e9405 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:44.331622 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1265f4ee-cd14-4310-bb60-b3e1a62e9405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:44.484792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265f4ee-cd14-4310-bb60-b3e1a62e9405 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:44.488814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:44.605789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0f0b8-4767-492e-916f-705dc8793274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:44.606561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0f0b8-4767-492e-916f-705dc8793274 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:44.606963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0f0b8-4767-492e-916f-705dc8793274 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:44.607371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0f0b8-4767-492e-916f-705dc8793274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:44.609054 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bae0f0b8-4767-492e-916f-705dc8793274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:44.703200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0f0b8-4767-492e-916f-705dc8793274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:44.705004 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0f0b8-4767-492e-916f-705dc8793274 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:44.726249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 530/1056] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:46.944519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aeeef-dfc9-4d0d-be35-be088b329b45 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:46.944949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aeeef-dfc9-4d0d-be35-be088b329b45 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:46.945130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aeeef-dfc9-4d0d-be35-be088b329b45 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:46.947635 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 527/1057] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:46.951926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d311b7-e05d-41ae-8de5-d8f935994674 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:46.952310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d311b7-e05d-41ae-8de5-d8f935994674 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:46.952472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d311b7-e05d-41ae-8de5-d8f935994674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:46.963971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:47.024540 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-18d311b7-e05d-41ae-8de5-d8f935994674 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:47.025917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-18d311b7-e05d-41ae-8de5-d8f935994674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:47.148172 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 531/1058] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:47.468458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aeeef-dfc9-4d0d-be35-be088b329b45 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:47.470322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-277aeeef-dfc9-4d0d-be35-be088b329b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:47.628190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:47.639528 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aeeef-dfc9-4d0d-be35-be088b329b45 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:47.769404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf545f7-8363-4488-98a5-5774e6266ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:47.769944 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf545f7-8363-4488-98a5-5774e6266ddf service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:47.770256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf545f7-8363-4488-98a5-5774e6266ddf service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:47.770530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf545f7-8363-4488-98a5-5774e6266ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:47.772238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8bf545f7-8363-4488-98a5-5774e6266ddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:47.862918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf545f7-8363-4488-98a5-5774e6266ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:47.864947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf545f7-8363-4488-98a5-5774e6266ddf service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:47.876546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:47.885241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 528/1059] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:50.071434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff13310-1af2-48bb-a868-9e7e1ce8d752 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:50.072093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff13310-1af2-48bb-a868-9e7e1ce8d752 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:50.072093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff13310-1af2-48bb-a868-9e7e1ce8d752 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:50.073329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 532/1060] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:50.078711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ced78-dfdc-4d8a-9454-76f2923622c6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:50.079136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ced78-dfdc-4d8a-9454-76f2923622c6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:50.079483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ced78-dfdc-4d8a-9454-76f2923622c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:50.146784 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ee8ced78-dfdc-4d8a-9454-76f2923622c6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:50.147951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ee8ced78-dfdc-4d8a-9454-76f2923622c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:50.263309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 529/1061] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:50.553900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff13310-1af2-48bb-a868-9e7e1ce8d752 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:50.555607 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fff13310-1af2-48bb-a868-9e7e1ce8d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:50.645304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:50.716624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff13310-1af2-48bb-a868-9e7e1ce8d752 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:50.839541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8dcff-8bac-46ae-be37-20d59e65507c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:50.840069 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8dcff-8bac-46ae-be37-20d59e65507c service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:50.840354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8dcff-8bac-46ae-be37-20d59e65507c service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:50.840616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8dcff-8bac-46ae-be37-20d59e65507c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:50.842205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fdf8dcff-8bac-46ae-be37-20d59e65507c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:50.894422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:50.940237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8dcff-8bac-46ae-be37-20d59e65507c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:50.941896 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8dcff-8bac-46ae-be37-20d59e65507c service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:50.962262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 533/1062] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:53.141759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259fd47-ccdd-4c4a-8e01-a1e15d0dd9bb None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:53.142280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259fd47-ccdd-4c4a-8e01-a1e15d0dd9bb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:53.142486 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259fd47-ccdd-4c4a-8e01-a1e15d0dd9bb None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:53.144330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 530/1063] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:53.150095 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a276-8ff7-4bc3-8ddb-f181e72e076e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:53.150550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a276-8ff7-4bc3-8ddb-f181e72e076e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:53.150675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a276-8ff7-4bc3-8ddb-f181e72e076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:53.226111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e6e8a276-8ff7-4bc3-8ddb-f181e72e076e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:53.227373 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e6e8a276-8ff7-4bc3-8ddb-f181e72e076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:53.336540 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 534/1064] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:53.621938 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259fd47-ccdd-4c4a-8e01-a1e15d0dd9bb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:53.623467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4259fd47-ccdd-4c4a-8e01-a1e15d0dd9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:53.701501 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:53.772300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259fd47-ccdd-4c4a-8e01-a1e15d0dd9bb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:53.891460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201c6d6-058c-407c-8761-d10be938b3e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:53.892074 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c6d6-058c-407c-8761-d10be938b3e7 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:53.892350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c6d6-058c-407c-8761-d10be938b3e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:53.892623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c6d6-058c-407c-8761-d10be938b3e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:53.894212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7201c6d6-058c-407c-8761-d10be938b3e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:53.932752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:53.985170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201c6d6-058c-407c-8761-d10be938b3e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:53.986736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201c6d6-058c-407c-8761-d10be938b3e7 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:54.004665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 531/1065] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:55.454094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf2906-9bfb-4bbc-aefb-b67c341094d7 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:55.454669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf2906-9bfb-4bbc-aefb-b67c341094d7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:55.454669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf2906-9bfb-4bbc-aefb-b67c341094d7 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:55.456030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 535/1066] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:55.461171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6f955-ea3d-42f3-9e9b-1677156fb459 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:55.461619 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6f955-ea3d-42f3-9e9b-1677156fb459 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:55.461763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6f955-ea3d-42f3-9e9b-1677156fb459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:55.527033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8de6f955-ea3d-42f3-9e9b-1677156fb459 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:55.528253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8de6f955-ea3d-42f3-9e9b-1677156fb459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:55.626430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 532/1067] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:55.927197 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642574-792b-4a8d-971b-286bcaf098d1 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:55.927583 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642574-792b-4a8d-971b-286bcaf098d1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:55.927929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642574-792b-4a8d-971b-286bcaf098d1 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:55.929379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 536/1068] 10.222.0.23 () {54 vars in 962 bytes} [Fri Oct 21 21:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:55.934971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae7b5-e775-46e1-9131-c7098d82b6a5 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:55.935258 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae7b5-e775-46e1-9131-c7098d82b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:55.935557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae7b5-e775-46e1-9131-c7098d82b6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:55.952002 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:56.012993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-16aae7b5-e775-46e1-9131-c7098d82b6a5 None None] MFA Rules not processed for user `59ec1b2a49264e4e9218b65f9ff114b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:56.014269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-16aae7b5-e775-46e1-9131-c7098d82b6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:56.100253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 533/1069] 10.222.0.23 () {58 vars in 1059 bytes} [Fri Oct 21 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:56.108242 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d642574-792b-4a8d-971b-286bcaf098d1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:56.109766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8d642574-792b-4a8d-971b-286bcaf098d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:56.140604 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:56.186299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c2c8d-be8b-442e-823f-3a13898f5c4a None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:56.186593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c2c8d-be8b-442e-823f-3a13898f5c4a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:56.187004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c2c8d-be8b-442e-823f-3a13898f5c4a None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:56.188390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 534/1070] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:13:56.193429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716ba8a-28bf-4686-9e01-33a22715253d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:56.193713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716ba8a-28bf-4686-9e01-33a22715253d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:56.193986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716ba8a-28bf-4686-9e01-33a22715253d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:56.215632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d642574-792b-4a8d-971b-286bcaf098d1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:56.262888 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9716ba8a-28bf-4686-9e01-33a22715253d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:56.264154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9716ba8a-28bf-4686-9e01-33a22715253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:56.289862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4db12d-0222-41eb-9974-0262bcc99be0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec1b2a49264e4e9218b65f9ff114b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:56.290470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4db12d-0222-41eb-9974-0262bcc99be0 service glance] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:56.290745 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4db12d-0222-41eb-9974-0262bcc99be0 service glance] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:56.291016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4db12d-0222-41eb-9974-0262bcc99be0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:56.292644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-aa4db12d-0222-41eb-9974-0262bcc99be0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:56.324246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:56.368557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 535/1071] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:13:56.374447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:56.406419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4db12d-0222-41eb-9974-0262bcc99be0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:56.407862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4db12d-0222-41eb-9974-0262bcc99be0 service glance] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:56.425504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 537/1072] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:56.661214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716ba8a-28bf-4686-9e01-33a22715253d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:56.662343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9716ba8a-28bf-4686-9e01-33a22715253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:56.784137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716ba8a-28bf-4686-9e01-33a22715253d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:56.875806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:56.923877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83df9d1-6901-4726-8f3b-233806f65553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:56.924487 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83df9d1-6901-4726-8f3b-233806f65553 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:56.924767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83df9d1-6901-4726-8f3b-233806f65553 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:56.925036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83df9d1-6901-4726-8f3b-233806f65553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:56.926603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c83df9d1-6901-4726-8f3b-233806f65553 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:57.024802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83df9d1-6901-4726-8f3b-233806f65553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:57.026413 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83df9d1-6901-4726-8f3b-233806f65553 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:57.046657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 536/1073] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:13:57.169870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a25636-fef7-459a-87f8-86357ba54700 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:57.170423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a25636-fef7-459a-87f8-86357ba54700 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:57.170629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a25636-fef7-459a-87f8-86357ba54700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:57.243973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-27a25636-fef7-459a-87f8-86357ba54700 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:57.245205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-27a25636-fef7-459a-87f8-86357ba54700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:57.333827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 538/1074] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:57.376756 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f0d5d-aa12-42a9-ae46-87cb1ae41886 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:57.377044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f0d5d-aa12-42a9-ae46-87cb1ae41886 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:57.377319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f0d5d-aa12-42a9-ae46-87cb1ae41886 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:57.378675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 537/1075] 10.222.0.23 () {54 vars in 943 bytes} [Fri Oct 21 21:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:57.385095 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43de1b-2c15-40f1-8234-c4922caa7bb7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:57.385444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43de1b-2c15-40f1-8234-c4922caa7bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:57.385780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43de1b-2c15-40f1-8234-c4922caa7bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:57.443799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:57.465269 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-2e43de1b-2c15-40f1-8234-c4922caa7bb7 None None] MFA Rules not processed for user `e2dc36f09ae941ecbf30ff11475e7f74`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:57.466469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2e43de1b-2c15-40f1-8234-c4922caa7bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:57.573636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 539/1076] 10.222.0.23 () {58 vars in 1040 bytes} [Fri Oct 21 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:13:57.582863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f0d5d-aa12-42a9-ae46-87cb1ae41886 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:57.584422 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-222f0d5d-aa12-42a9-ae46-87cb1ae41886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:57.664537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:57.722628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f0d5d-aa12-42a9-ae46-87cb1ae41886 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:13:57.828309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c9103-3ff8-47c0-af36-b14a37cf163f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:13:57.828921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c9103-3ff8-47c0-af36-b14a37cf163f service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:57.829200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c9103-3ff8-47c0-af36-b14a37cf163f service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:57.829472 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c9103-3ff8-47c0-af36-b14a37cf163f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:57.831118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ba9c9103-3ff8-47c0-af36-b14a37cf163f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:57.897810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:57.918369 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c9103-3ff8-47c0-af36-b14a37cf163f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:13:57.919992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c9103-3ff8-47c0-af36-b14a37cf163f service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:13:57.928036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 538/1077] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:13:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:13:59.243207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3cc02-20c2-4928-bd47-b48a4511f2ac None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:59.243873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3cc02-20c2-4928-bd47-b48a4511f2ac None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:59.243873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3cc02-20c2-4928-bd47-b48a4511f2ac None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:59.245393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 540/1078] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:13:59.263584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1709e54-8175-493c-ab16-90262fa393c9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:13:59.263584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1709e54-8175-493c-ab16-90262fa393c9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:13:59.263584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1709e54-8175-493c-ab16-90262fa393c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:13:59.388273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d1709e54-8175-493c-ab16-90262fa393c9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:13:59.391942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d1709e54-8175-493c-ab16-90262fa393c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:59.504852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 539/1079] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:13:59.801157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3cc02-20c2-4928-bd47-b48a4511f2ac None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:13:59.802691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-efc3cc02-20c2-4928-bd47-b48a4511f2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:13:59.922491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:13:59.972493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3cc02-20c2-4928-bd47-b48a4511f2ac None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:00.098582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8258fb-4918-4b2b-aa3e-8983568cc49e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:00.099222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8258fb-4918-4b2b-aa3e-8983568cc49e service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:00.099528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8258fb-4918-4b2b-aa3e-8983568cc49e service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:00.099806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8258fb-4918-4b2b-aa3e-8983568cc49e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:00.101452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ec8258fb-4918-4b2b-aa3e-8983568cc49e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:00.178199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:00.199470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8258fb-4918-4b2b-aa3e-8983568cc49e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:00.201202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8258fb-4918-4b2b-aa3e-8983568cc49e service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:00.222403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 541/1080] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:02.436543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c728d-0c90-4002-90b4-0494d34ab73a None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:02.437034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c728d-0c90-4002-90b4-0494d34ab73a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:02.438022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c728d-0c90-4002-90b4-0494d34ab73a None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:02.444886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 540/1081] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:14:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:02.446791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8908a4-d6fa-48c8-afbd-e96b5acaec04 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:02.447231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8908a4-d6fa-48c8-afbd-e96b5acaec04 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:02.447391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8908a4-d6fa-48c8-afbd-e96b5acaec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:02.516767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0d8908a4-d6fa-48c8-afbd-e96b5acaec04 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:02.518382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0d8908a4-d6fa-48c8-afbd-e96b5acaec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:02.625855 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 542/1082] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:14:02.917185 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c728d-0c90-4002-90b4-0494d34ab73a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:02.918719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cc2c728d-0c90-4002-90b4-0494d34ab73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:02.988687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:03.087059 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c728d-0c90-4002-90b4-0494d34ab73a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:03.215200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b571c-045d-4a24-8a90-16d1b8464f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:03.215962 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b571c-045d-4a24-8a90-16d1b8464f4c service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:03.216329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b571c-045d-4a24-8a90-16d1b8464f4c service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:03.216664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b571c-045d-4a24-8a90-16d1b8464f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:03.218337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d70b571c-045d-4a24-8a90-16d1b8464f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:03.239040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:03.349562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b571c-045d-4a24-8a90-16d1b8464f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:03.349562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b571c-045d-4a24-8a90-16d1b8464f4c service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:03.382953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 541/1083] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:05.589625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d899b-771b-4fe2-a5c8-c8cf2a47d91a None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:05.590181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d899b-771b-4fe2-a5c8-c8cf2a47d91a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:05.590539 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d899b-771b-4fe2-a5c8-c8cf2a47d91a None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:05.592044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 543/1084] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:05.597657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992be7-1e31-4551-b2b8-017009f222d4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:05.598098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992be7-1e31-4551-b2b8-017009f222d4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:05.598216 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992be7-1e31-4551-b2b8-017009f222d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:05.670316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-aa992be7-1e31-4551-b2b8-017009f222d4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:05.671582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-aa992be7-1e31-4551-b2b8-017009f222d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:05.778885 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:05.786728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 542/1085] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:06.075858 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d899b-771b-4fe2-a5c8-c8cf2a47d91a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:06.077452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f15d899b-771b-4fe2-a5c8-c8cf2a47d91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:06.135369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:06.244556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d899b-771b-4fe2-a5c8-c8cf2a47d91a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:06.369762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc5cbe-503e-4489-abf1-e70b8e173521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:06.369762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc5cbe-503e-4489-abf1-e70b8e173521 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:06.369762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc5cbe-503e-4489-abf1-e70b8e173521 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:06.369762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc5cbe-503e-4489-abf1-e70b8e173521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:06.371444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-46dc5cbe-503e-4489-abf1-e70b8e173521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:06.379896 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:06.476664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc5cbe-503e-4489-abf1-e70b8e173521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:06.478260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc5cbe-503e-4489-abf1-e70b8e173521 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:06.497140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 544/1086] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:15.784861 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:16.494964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=42 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:20.500965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6351444-c865-42b3-abc3-e03b77d6c593 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:20.501503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6351444-c865-42b3-abc3-e03b77d6c593 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:20.501646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6351444-c865-42b3-abc3-e03b77d6c593 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:20.502936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 543/1087] 10.222.0.23 () {54 vars in 918 bytes} [Fri Oct 21 21:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:20.507956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39774448-99d3-4d87-ac8d-b8e88aa24f4e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:20.508370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39774448-99d3-4d87-ac8d-b8e88aa24f4e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:20.508504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39774448-99d3-4d87-ac8d-b8e88aa24f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:20.582862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-39774448-99d3-4d87-ac8d-b8e88aa24f4e None None] MFA Rules not processed for user `aa89e84c708f44c299c728284e33fabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:20.584103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-39774448-99d3-4d87-ac8d-b8e88aa24f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:20.688650 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 545/1088] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Oct 21 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:14:20.703245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba7a60-5d3d-4717-b24a-cebe4cc14e3c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:20.703546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba7a60-5d3d-4717-b24a-cebe4cc14e3c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:20.703818 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba7a60-5d3d-4717-b24a-cebe4cc14e3c None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:20.705139 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 544/1089] 10.222.0.23 () {54 vars in 918 bytes} [Fri Oct 21 21:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:20.709548 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabec5f-cca6-4b3d-968e-6379d4d94d04 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:20.710372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabec5f-cca6-4b3d-968e-6379d4d94d04 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:20.710641 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabec5f-cca6-4b3d-968e-6379d4d94d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:20.782006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:20.785049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-beabec5f-cca6-4b3d-968e-6379d4d94d04 None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:20.786788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-beabec5f-cca6-4b3d-968e-6379d4d94d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:20.900607 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 546/1090] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Oct 21 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:23.442957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e485a-197d-40c7-a23e-09f6f2ae0bdd None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:23.443513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e485a-197d-40c7-a23e-09f6f2ae0bdd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:23.443628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e485a-197d-40c7-a23e-09f6f2ae0bdd None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:23.445482 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 545/1091] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:23.450866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87afed-65e4-48cd-a5ce-2fe5142c10d1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:23.451254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87afed-65e4-48cd-a5ce-2fe5142c10d1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:23.451449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87afed-65e4-48cd-a5ce-2fe5142c10d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:23.515807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4e87afed-65e4-48cd-a5ce-2fe5142c10d1 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:23.517028 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4e87afed-65e4-48cd-a5ce-2fe5142c10d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:23.572418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:23.613407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 547/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:23.900910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e485a-197d-40c7-a23e-09f6f2ae0bdd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:23.902528 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-741e485a-197d-40c7-a23e-09f6f2ae0bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:24.047776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e485a-197d-40c7-a23e-09f6f2ae0bdd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:24.120170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:24.159468 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f8b8b-86be-4f51-8810-595e60c4c8df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:24.159991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8b8b-86be-4f51-8810-595e60c4c8df service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:24.160269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8b8b-86be-4f51-8810-595e60c4c8df service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:24.160537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8b8b-86be-4f51-8810-595e60c4c8df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:24.162116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5a4f8b8b-86be-4f51-8810-595e60c4c8df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:24.252011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f8b8b-86be-4f51-8810-595e60c4c8df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:24.253596 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f8b8b-86be-4f51-8810-595e60c4c8df service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:24.271874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 546/1093] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:25.394135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a86790-7b2f-443f-b37d-fada27eabf24 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:25.394657 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a86790-7b2f-443f-b37d-fada27eabf24 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:25.394657 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a86790-7b2f-443f-b37d-fada27eabf24 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:25.396004 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 548/1094] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:25.402081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bd0ca-17d9-4301-9058-7e2ac4c7ec8a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:25.402526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bd0ca-17d9-4301-9058-7e2ac4c7ec8a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:25.402630 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bd0ca-17d9-4301-9058-7e2ac4c7ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:25.477709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-784bd0ca-17d9-4301-9058-7e2ac4c7ec8a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:25.478933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-784bd0ca-17d9-4301-9058-7e2ac4c7ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:25.505604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:25.575536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 547/1095] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:25.726328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a86790-7b2f-443f-b37d-fada27eabf24 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:25.727886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-79a86790-7b2f-443f-b37d-fada27eabf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:25.872278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a86790-7b2f-443f-b37d-fada27eabf24 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:25.912325 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:25.985114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92ba85-fcaa-4ffb-bb62-0f6155358e7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:25.985651 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92ba85-fcaa-4ffb-bb62-0f6155358e7d service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:25.985933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92ba85-fcaa-4ffb-bb62-0f6155358e7d service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:25.986207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92ba85-fcaa-4ffb-bb62-0f6155358e7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:25.987845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ab92ba85-fcaa-4ffb-bb62-0f6155358e7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:26.076737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92ba85-fcaa-4ffb-bb62-0f6155358e7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:26.078315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92ba85-fcaa-4ffb-bb62-0f6155358e7d service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:26.096330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 549/1096] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:27.210482 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5088793-e677-4454-96fe-e8b6a128d377 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:27.211040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5088793-e677-4454-96fe-e8b6a128d377 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:27.211040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5088793-e677-4454-96fe-e8b6a128d377 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:27.212419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 548/1097] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:27.218431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9231-cd20-4b2e-a655-e0c011dd1595 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:27.218875 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9231-cd20-4b2e-a655-e0c011dd1595 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:27.218984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9231-cd20-4b2e-a655-e0c011dd1595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:27.272430 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:27.294601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-aebc9231-cd20-4b2e-a655-e0c011dd1595 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:27.295835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-aebc9231-cd20-4b2e-a655-e0c011dd1595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:27.391525 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 550/1098] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:27.539435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5088793-e677-4454-96fe-e8b6a128d377 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:27.540937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b5088793-e677-4454-96fe-e8b6a128d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:27.684468 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5088793-e677-4454-96fe-e8b6a128d377 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:27.696658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:27.799847 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0085009-7f06-4d2a-8091-8f172f48bfa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:27.800451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0085009-7f06-4d2a-8091-8f172f48bfa7 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:27.800730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0085009-7f06-4d2a-8091-8f172f48bfa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:27.801002 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0085009-7f06-4d2a-8091-8f172f48bfa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:27.802584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0085009-7f06-4d2a-8091-8f172f48bfa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:27.892133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0085009-7f06-4d2a-8091-8f172f48bfa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:27.893726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0085009-7f06-4d2a-8091-8f172f48bfa7 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:27.912086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 549/1099] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:29.010208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29f31-7536-437d-8ec6-45cbb3e91515 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:29.010778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29f31-7536-437d-8ec6-45cbb3e91515 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:29.010778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29f31-7536-437d-8ec6-45cbb3e91515 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:29.012108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 551/1100] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:29.018199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74caeec-879b-4fc4-974d-2227a01550e9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:29.018645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74caeec-879b-4fc4-974d-2227a01550e9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:29.018743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74caeec-879b-4fc4-974d-2227a01550e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:29.038551 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:29.096516 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a74caeec-879b-4fc4-974d-2227a01550e9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:29.097762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a74caeec-879b-4fc4-974d-2227a01550e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:29.192197 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 550/1101] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:29.341114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29f31-7536-437d-8ec6-45cbb3e91515 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:29.342559 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e5c29f31-7536-437d-8ec6-45cbb3e91515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:29.452784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:29.487916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29f31-7536-437d-8ec6-45cbb3e91515 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:29.598347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422ec3e-04ed-4fbb-b3b7-00299c0bceec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:29.598930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422ec3e-04ed-4fbb-b3b7-00299c0bceec service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:29.599213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422ec3e-04ed-4fbb-b3b7-00299c0bceec service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:29.599515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422ec3e-04ed-4fbb-b3b7-00299c0bceec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:29.601108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c422ec3e-04ed-4fbb-b3b7-00299c0bceec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:29.675655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:29.689688 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422ec3e-04ed-4fbb-b3b7-00299c0bceec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:29.691255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422ec3e-04ed-4fbb-b3b7-00299c0bceec service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:29.709256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 552/1102] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:30.808757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea069009-6307-4eb8-8917-18ce959b60ac None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:30.809411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea069009-6307-4eb8-8917-18ce959b60ac None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:30.809411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea069009-6307-4eb8-8917-18ce959b60ac None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:30.810694 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 551/1103] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:30.816721 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65250950-3480-4800-811c-155db4dde0ff None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:30.817221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65250950-3480-4800-811c-155db4dde0ff None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:30.817321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65250950-3480-4800-811c-155db4dde0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:30.892049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-65250950-3480-4800-811c-155db4dde0ff None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:30.893231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-65250950-3480-4800-811c-155db4dde0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:30.989367 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 553/1104] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:31.138535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea069009-6307-4eb8-8917-18ce959b60ac None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:31.140024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ea069009-6307-4eb8-8917-18ce959b60ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:31.223993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:31.285679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea069009-6307-4eb8-8917-18ce959b60ac None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:31.397205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c0469-e10b-4c8f-8748-70d62fc1133b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:31.397725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c0469-e10b-4c8f-8748-70d62fc1133b service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:31.397999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c0469-e10b-4c8f-8748-70d62fc1133b service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:31.398265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c0469-e10b-4c8f-8748-70d62fc1133b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:31.399866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7b1c0469-e10b-4c8f-8748-70d62fc1133b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:31.448724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:31.489642 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c0469-e10b-4c8f-8748-70d62fc1133b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:31.491883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c0469-e10b-4c8f-8748-70d62fc1133b service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:31.509346 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 552/1105] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:32.561141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6845946-550c-424d-a405-e58e6ca60b8d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:32.561699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6845946-550c-424d-a405-e58e6ca60b8d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:32.561699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6845946-550c-424d-a405-e58e6ca60b8d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:32.563044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 554/1106] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:32.569739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5c47-0cdd-4d66-b0d9-4b0f1e5c81db None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:32.570179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5c47-0cdd-4d66-b0d9-4b0f1e5c81db None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:32.570290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5c47-0cdd-4d66-b0d9-4b0f1e5c81db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:32.644977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-cb7b5c47-0cdd-4d66-b0d9-4b0f1e5c81db None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:32.646180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cb7b5c47-0cdd-4d66-b0d9-4b0f1e5c81db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:32.744251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 553/1107] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:14:32.891892 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6845946-550c-424d-a405-e58e6ca60b8d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:32.893408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a6845946-550c-424d-a405-e58e6ca60b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:32.943046 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:33.039695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6845946-550c-424d-a405-e58e6ca60b8d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:33.149948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaf3fe-26c0-41ea-810a-333cd7a1536d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:33.150553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaf3fe-26c0-41ea-810a-333cd7a1536d service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:33.150831 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaf3fe-26c0-41ea-810a-333cd7a1536d service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:33.151104 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaf3fe-26c0-41ea-810a-333cd7a1536d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:33.152726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1bdaf3fe-26c0-41ea-810a-333cd7a1536d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:33.159587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:33.241114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaf3fe-26c0-41ea-810a-333cd7a1536d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:33.242690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaf3fe-26c0-41ea-810a-333cd7a1536d service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:33.260008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 555/1108] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:34.311220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf616a-45d3-480c-9a57-051105a1613f None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:34.311846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf616a-45d3-480c-9a57-051105a1613f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:34.311846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf616a-45d3-480c-9a57-051105a1613f None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:34.313184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 554/1109] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:34.320102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1126a-9e7f-4149-914d-deff28bc3083 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:34.320837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1126a-9e7f-4149-914d-deff28bc3083 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:34.320942 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1126a-9e7f-4149-914d-deff28bc3083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:34.396027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d6a1126a-9e7f-4149-914d-deff28bc3083 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:34.397236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d6a1126a-9e7f-4149-914d-deff28bc3083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:34.464143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:34.494278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 556/1110] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:34.642605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf616a-45d3-480c-9a57-051105a1613f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:34.644178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2caf616a-45d3-480c-9a57-051105a1613f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:34.662754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:34.789299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf616a-45d3-480c-9a57-051105a1613f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:34.876877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:34.903311 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fc8d4-6282-4c28-b674-509241c256ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:34.903921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fc8d4-6282-4c28-b674-509241c256ab service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:34.904201 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fc8d4-6282-4c28-b674-509241c256ab service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:34.904474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fc8d4-6282-4c28-b674-509241c256ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:34.906097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-282fc8d4-6282-4c28-b674-509241c256ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:34.995294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fc8d4-6282-4c28-b674-509241c256ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:34.996890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fc8d4-6282-4c28-b674-509241c256ab service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:35.014424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 555/1111] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:36.052126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b60a15-4b84-4f4c-ad50-d614f15ce45a None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:36.052653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b60a15-4b84-4f4c-ad50-d614f15ce45a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:36.052653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b60a15-4b84-4f4c-ad50-d614f15ce45a None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:36.054177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 557/1112] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:36.060685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac207ec-a380-43b3-a174-1932fe982a4e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:36.061115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac207ec-a380-43b3-a174-1932fe982a4e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:36.061219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac207ec-a380-43b3-a174-1932fe982a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:36.136289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8ac207ec-a380-43b3-a174-1932fe982a4e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:36.137478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8ac207ec-a380-43b3-a174-1932fe982a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:36.179139 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:36.233758 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 556/1113] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:36.381194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b60a15-4b84-4f4c-ad50-d614f15ce45a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:36.382832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c7b60a15-4b84-4f4c-ad50-d614f15ce45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:36.527037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b60a15-4b84-4f4c-ad50-d614f15ce45a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:36.580350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:36.639714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e7b10-023a-4850-b669-38fbf875852a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:36.640329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e7b10-023a-4850-b669-38fbf875852a service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:36.640611 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e7b10-023a-4850-b669-38fbf875852a service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:36.640885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e7b10-023a-4850-b669-38fbf875852a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:36.642487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c32e7b10-023a-4850-b669-38fbf875852a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:36.732561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e7b10-023a-4850-b669-38fbf875852a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:36.734132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e7b10-023a-4850-b669-38fbf875852a service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:36.751570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 558/1114] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:37.800376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0219d-6ddc-4367-baea-870c1c6da3d4 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:37.801025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0219d-6ddc-4367-baea-870c1c6da3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:37.801025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0219d-6ddc-4367-baea-870c1c6da3d4 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:37.802254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 557/1115] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:37.808907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10af0c-a830-497e-b02a-a190c711a6f7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:37.809339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10af0c-a830-497e-b02a-a190c711a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:37.809489 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10af0c-a830-497e-b02a-a190c711a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:37.884296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3e10af0c-a830-497e-b02a-a190c711a6f7 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:37.885491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3e10af0c-a830-497e-b02a-a190c711a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:37.887507 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:37.981899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 559/1116] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:38.129700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0219d-6ddc-4367-baea-870c1c6da3d4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:38.131753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-07a0219d-6ddc-4367-baea-870c1c6da3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:38.275494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0219d-6ddc-4367-baea-870c1c6da3d4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:38.303616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:38.392040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68407fb-4daa-490b-9467-eac2427ac0dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:38.392567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68407fb-4daa-490b-9467-eac2427ac0dd service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:38.392846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68407fb-4daa-490b-9467-eac2427ac0dd service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:38.393125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68407fb-4daa-490b-9467-eac2427ac0dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:38.394713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a68407fb-4daa-490b-9467-eac2427ac0dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:38.483741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68407fb-4daa-490b-9467-eac2427ac0dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:38.485312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68407fb-4daa-490b-9467-eac2427ac0dd service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:38.502744 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 558/1117] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:40.563258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0ad61-e0fc-44bc-aa1f-0d90dc5931f6 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:40.563843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0ad61-e0fc-44bc-aa1f-0d90dc5931f6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:40.563843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0ad61-e0fc-44bc-aa1f-0d90dc5931f6 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:40.565222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 560/1118] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:40.570978 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8630623-0ca3-40e3-a4e5-482cdb88904f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:40.571440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8630623-0ca3-40e3-a4e5-482cdb88904f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:40.571599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8630623-0ca3-40e3-a4e5-482cdb88904f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:40.612392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:40.637498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f8630623-0ca3-40e3-a4e5-482cdb88904f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:40.638701 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f8630623-0ca3-40e3-a4e5-482cdb88904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:40.733546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 559/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:41.015963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0ad61-e0fc-44bc-aa1f-0d90dc5931f6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:41.017496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b7e0ad61-e0fc-44bc-aa1f-0d90dc5931f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:41.119982 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0ad61-e0fc-44bc-aa1f-0d90dc5931f6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:41.152444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:41.192384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce8dc3-0907-4164-8b3f-ee4b38912460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:41.193531 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce8dc3-0907-4164-8b3f-ee4b38912460 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:41.193827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce8dc3-0907-4164-8b3f-ee4b38912460 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:41.194095 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce8dc3-0907-4164-8b3f-ee4b38912460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:41.195944 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-cdce8dc3-0907-4164-8b3f-ee4b38912460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:41.301869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce8dc3-0907-4164-8b3f-ee4b38912460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:41.303778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce8dc3-0907-4164-8b3f-ee4b38912460 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:41.322169 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 561/1120] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:43.612901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b69332-c9cb-428a-ab82-e2a112be4621 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:43.613440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b69332-c9cb-428a-ab82-e2a112be4621 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:43.613440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b69332-c9cb-428a-ab82-e2a112be4621 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:43.615630 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 560/1121] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:43.620590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0f1c-49af-42db-a587-42233acee501 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:43.621026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0f1c-49af-42db-a587-42233acee501 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:43.621137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0f1c-49af-42db-a587-42233acee501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:43.686014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-10fc0f1c-49af-42db-a587-42233acee501 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:43.687212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-10fc0f1c-49af-42db-a587-42233acee501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:43.700598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:43.783114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 562/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:44.072804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b69332-c9cb-428a-ab82-e2a112be4621 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:44.074314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c2b69332-c9cb-428a-ab82-e2a112be4621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:44.175551 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b69332-c9cb-428a-ab82-e2a112be4621 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:44.188623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:44.251960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfd324-d13e-4e49-a9fb-01a00b3277ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:44.252571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd324-d13e-4e49-a9fb-01a00b3277ea service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:44.252848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd324-d13e-4e49-a9fb-01a00b3277ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:44.253118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd324-d13e-4e49-a9fb-01a00b3277ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:44.254693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-55bfd324-d13e-4e49-a9fb-01a00b3277ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:44.363396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfd324-d13e-4e49-a9fb-01a00b3277ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:44.365319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfd324-d13e-4e49-a9fb-01a00b3277ea service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:44.383648 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 561/1123] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:46.806137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af855-650b-422c-8355-95df76d974ae None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:46.806699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af855-650b-422c-8355-95df76d974ae None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:46.806699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af855-650b-422c-8355-95df76d974ae None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:46.808087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 563/1124] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:46.813279 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da7b9f-8d5c-4c53-8a06-83122fcb7611 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:46.813696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da7b9f-8d5c-4c53-8a06-83122fcb7611 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:46.813823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da7b9f-8d5c-4c53-8a06-83122fcb7611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:46.861896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:46.879556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-24da7b9f-8d5c-4c53-8a06-83122fcb7611 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:46.880766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-24da7b9f-8d5c-4c53-8a06-83122fcb7611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:46.977003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 562/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:47.257666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81af855-650b-422c-8355-95df76d974ae None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:47.259185 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c81af855-650b-422c-8355-95df76d974ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:47.361598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81af855-650b-422c-8355-95df76d974ae None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:47.401281 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:47.434363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad74e1-48ad-4c9b-9467-ebbc263d1b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:47.434963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad74e1-48ad-4c9b-9467-ebbc263d1b34 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:47.435244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad74e1-48ad-4c9b-9467-ebbc263d1b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:47.435551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad74e1-48ad-4c9b-9467-ebbc263d1b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:47.437136 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c8ad74e1-48ad-4c9b-9467-ebbc263d1b34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:47.544259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad74e1-48ad-4c9b-9467-ebbc263d1b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:47.545696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad74e1-48ad-4c9b-9467-ebbc263d1b34 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:47.563385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 564/1126] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:49.842254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddf570-39a3-4945-8e20-34d7c4890c1e None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:49.842835 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddf570-39a3-4945-8e20-34d7c4890c1e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:49.842835 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddf570-39a3-4945-8e20-34d7c4890c1e None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:49.844188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 563/1127] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:49.849565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398da8c-6a3a-4841-9417-6359269ecd78 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:49.850477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398da8c-6a3a-4841-9417-6359269ecd78 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:49.850712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398da8c-6a3a-4841-9417-6359269ecd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:49.915638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0398da8c-6a3a-4841-9417-6359269ecd78 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:49.916829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0398da8c-6a3a-4841-9417-6359269ecd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:49.936726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:50.014087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 565/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:50.301127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddf570-39a3-4945-8e20-34d7c4890c1e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:50.303288 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-30ddf570-39a3-4945-8e20-34d7c4890c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:50.405033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddf570-39a3-4945-8e20-34d7c4890c1e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:50.425077 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:50.477789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25057693-fd19-47de-85c1-50edfd7f87e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:50.478386 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25057693-fd19-47de-85c1-50edfd7f87e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:50.478662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25057693-fd19-47de-85c1-50edfd7f87e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:50.478933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25057693-fd19-47de-85c1-50edfd7f87e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:50.480544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-25057693-fd19-47de-85c1-50edfd7f87e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:50.587433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25057693-fd19-47de-85c1-50edfd7f87e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:50.588771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25057693-fd19-47de-85c1-50edfd7f87e4 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:50.606562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 564/1129] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:52.896397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7c6e9-5aee-4c68-a90c-626ea917956b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:52.896966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7c6e9-5aee-4c68-a90c-626ea917956b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:52.896966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7c6e9-5aee-4c68-a90c-626ea917956b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:52.898347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 566/1130] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:52.903837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aca84-e827-4bf7-9eaa-4013d082938c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:52.904250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aca84-e827-4bf7-9eaa-4013d082938c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:52.904367 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aca84-e827-4bf7-9eaa-4013d082938c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:52.967137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:52.969812 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f36aca84-e827-4bf7-9eaa-4013d082938c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:52.971711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f36aca84-e827-4bf7-9eaa-4013d082938c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:53.067034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 565/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:53.355670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7c6e9-5aee-4c68-a90c-626ea917956b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:53.357236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-64c7c6e9-5aee-4c68-a90c-626ea917956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:53.459762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7c6e9-5aee-4c68-a90c-626ea917956b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:53.508189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:53.532222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d7377-dfc5-4865-a9e0-0024c45bfb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:53.532828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7377-dfc5-4865-a9e0-0024c45bfb4e service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:53.533121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7377-dfc5-4865-a9e0-0024c45bfb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:53.533387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7377-dfc5-4865-a9e0-0024c45bfb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:53.535045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-939d7377-dfc5-4865-a9e0-0024c45bfb4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:53.642789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d7377-dfc5-4865-a9e0-0024c45bfb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:53.644170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d7377-dfc5-4865-a9e0-0024c45bfb4e service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:53.662241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 567/1132] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:55.825194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b754d-7b84-4b85-a0c4-1fd26fe66b0d None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:55.825753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b754d-7b84-4b85-a0c4-1fd26fe66b0d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:55.825753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b754d-7b84-4b85-a0c4-1fd26fe66b0d None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:55.827063 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 566/1133] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:55.832286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d6b2-a487-40a2-84a0-9ff3461f5230 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:55.832676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d6b2-a487-40a2-84a0-9ff3461f5230 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:55.832825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d6b2-a487-40a2-84a0-9ff3461f5230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:55.898592 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c833d6b2-a487-40a2-84a0-9ff3461f5230 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:55.899829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c833d6b2-a487-40a2-84a0-9ff3461f5230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:55.929402 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:55.996408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 568/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:56.278956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b754d-7b84-4b85-a0c4-1fd26fe66b0d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:56.280592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1c1b754d-7b84-4b85-a0c4-1fd26fe66b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:56.382987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b754d-7b84-4b85-a0c4-1fd26fe66b0d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:56.410903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:56.456956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754fa34-e556-4756-89c9-e9fa8464c3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:56.457554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754fa34-e556-4756-89c9-e9fa8464c3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:56.457852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754fa34-e556-4756-89c9-e9fa8464c3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:56.458130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754fa34-e556-4756-89c9-e9fa8464c3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:56.459752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d754fa34-e556-4756-89c9-e9fa8464c3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:56.569062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754fa34-e556-4756-89c9-e9fa8464c3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:56.570647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754fa34-e556-4756-89c9-e9fa8464c3c4 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:56.588430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 567/1135] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:14:58.782994 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be231add-c513-4cea-8226-c879098d6651 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:58.783584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be231add-c513-4cea-8226-c879098d6651 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:58.783584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be231add-c513-4cea-8226-c879098d6651 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:58.784931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 569/1136] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:14:58.790228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11785-9cf2-4e44-ba8a-80e49d32bcd0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:58.790661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11785-9cf2-4e44-ba8a-80e49d32bcd0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:58.790791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11785-9cf2-4e44-ba8a-80e49d32bcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:58.856318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e6b11785-9cf2-4e44-ba8a-80e49d32bcd0 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:14:58.857523 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e6b11785-9cf2-4e44-ba8a-80e49d32bcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:58.866323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:58.956021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 568/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:14:59.241311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be231add-c513-4cea-8226-c879098d6651 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:14:59.242636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-be231add-c513-4cea-8226-c879098d6651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:59.345228 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be231add-c513-4cea-8226-c879098d6651 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:14:59.401782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:14:59.420203 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ada530-56d0-4827-bf47-3e414c77d006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:14:59.421080 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ada530-56d0-4827-bf47-3e414c77d006 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:14:59.421357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ada530-56d0-4827-bf47-3e414c77d006 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:14:59.421624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ada530-56d0-4827-bf47-3e414c77d006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:14:59.423205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-82ada530-56d0-4827-bf47-3e414c77d006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:14:59.528188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ada530-56d0-4827-bf47-3e414c77d006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:14:59.529602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ada530-56d0-4827-bf47-3e414c77d006 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:14:59.547443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 570/1138] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:15:01.900192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5d853-f3c6-462a-aba2-dc1179b03d9a None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:01.900762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5d853-f3c6-462a-aba2-dc1179b03d9a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:01.900762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5d853-f3c6-462a-aba2-dc1179b03d9a None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:01.902036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:01.907498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c1ba-999b-41e9-b7d7-81b55167aafb None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:01.907931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c1ba-999b-41e9-b7d7-81b55167aafb None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:01.908118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c1ba-999b-41e9-b7d7-81b55167aafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:01.977245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1020c1ba-999b-41e9-b7d7-81b55167aafb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:01.978458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1020c1ba-999b-41e9-b7d7-81b55167aafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:02.016663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:02.076279 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:15:02.359623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5d853-f3c6-462a-aba2-dc1179b03d9a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:15:02.361161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-61c5d853-f3c6-462a-aba2-dc1179b03d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:02.467745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5d853-f3c6-462a-aba2-dc1179b03d9a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:15:02.505752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:02.541749 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdae0c-5e0a-46c1-beba-9668090289f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:15:02.542356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdae0c-5e0a-46c1-beba-9668090289f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:02.542634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdae0c-5e0a-46c1-beba-9668090289f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:02.542907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdae0c-5e0a-46c1-beba-9668090289f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:02.544532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-73fdae0c-5e0a-46c1-beba-9668090289f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:02.653497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdae0c-5e0a-46c1-beba-9668090289f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:15:02.654832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdae0c-5e0a-46c1-beba-9668090289f2 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:15:02.672826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 570/1141] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:15:04.849305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac64e93-3252-4d89-bbd2-793e7ac11f01 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:04.849902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac64e93-3252-4d89-bbd2-793e7ac11f01 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:04.849902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac64e93-3252-4d89-bbd2-793e7ac11f01 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:04.851187 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 572/1142] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:04.856409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170adeb1-13aa-48a1-b1da-0933e6f16210 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:04.856841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170adeb1-13aa-48a1-b1da-0933e6f16210 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:04.856958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170adeb1-13aa-48a1-b1da-0933e6f16210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:04.922735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-170adeb1-13aa-48a1-b1da-0933e6f16210 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:04.923964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-170adeb1-13aa-48a1-b1da-0933e6f16210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:04.941494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:05.019034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 571/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:15:05.297930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac64e93-3252-4d89-bbd2-793e7ac11f01 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:15:05.299481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8ac64e93-3252-4d89-bbd2-793e7ac11f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:05.401825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac64e93-3252-4d89-bbd2-793e7ac11f01 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:15:05.469213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:05.476674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aa584-35bd-4d7d-8a66-948740e16223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:15:05.477275 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa584-35bd-4d7d-8a66-948740e16223 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:05.477553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa584-35bd-4d7d-8a66-948740e16223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:05.477830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa584-35bd-4d7d-8a66-948740e16223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:05.479439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-031aa584-35bd-4d7d-8a66-948740e16223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:05.585467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aa584-35bd-4d7d-8a66-948740e16223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:15:05.586827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aa584-35bd-4d7d-8a66-948740e16223 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:15:05.607333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 573/1144] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:15:07.759695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b559a-9c23-44d1-b4b1-3620a5fb62be None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:07.760235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b559a-9c23-44d1-b4b1-3620a5fb62be None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:07.760235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b559a-9c23-44d1-b4b1-3620a5fb62be None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:07.761616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:07.766793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383507-d860-401b-9a76-c9ba60d0910e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:07.767243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383507-d860-401b-9a76-c9ba60d0910e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:07.767372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383507-d860-401b-9a76-c9ba60d0910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:07.833144 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-94383507-d860-401b-9a76-c9ba60d0910e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:07.834438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-94383507-d860-401b-9a76-c9ba60d0910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:07.881954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:07.931932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:15:08.211970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b559a-9c23-44d1-b4b1-3620a5fb62be None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:15:08.213505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e92b559a-9c23-44d1-b4b1-3620a5fb62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:08.316826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b559a-9c23-44d1-b4b1-3620a5fb62be None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:15:08.366438 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:08.392233 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa9cab-d0d9-4d4d-ac9b-d3c4db747163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:15:08.392838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9cab-d0d9-4d4d-ac9b-d3c4db747163 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:08.393118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9cab-d0d9-4d4d-ac9b-d3c4db747163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:08.393394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9cab-d0d9-4d4d-ac9b-d3c4db747163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:08.394976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dcaa9cab-d0d9-4d4d-ac9b-d3c4db747163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:08.501492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa9cab-d0d9-4d4d-ac9b-d3c4db747163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:15:08.502911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa9cab-d0d9-4d4d-ac9b-d3c4db747163 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:15:08.521060 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 573/1147] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:15:17.930331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=22 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:18.518726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=66 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:28.937077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102392-1a13-4971-8e93-f1292c99b0cb None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:28.937635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102392-1a13-4971-8e93-f1292c99b0cb None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:28.937635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90102392-1a13-4971-8e93-f1292c99b0cb None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:28.938979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 575/1148] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:28.944567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edde27-2b93-4328-b7b1-d4b33336fbca None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:28.944993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edde27-2b93-4328-b7b1-d4b33336fbca None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:28.945100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edde27-2b93-4328-b7b1-d4b33336fbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:29.011859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-80edde27-2b93-4328-b7b1-d4b33336fbca None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:29.013051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-80edde27-2b93-4328-b7b1-d4b33336fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:29.109735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 574/1149] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:15:29.409123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8c3f6-619d-4077-ae12-f82968b551b8 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:29.409404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8c3f6-619d-4077-ae12-f82968b551b8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:29.409674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8c3f6-619d-4077-ae12-f82968b551b8 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:29.411053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 576/1150] 10.222.0.23 () {54 vars in 962 bytes} [Fri Oct 21 21:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:29.416592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a8a7a-5a43-498c-abae-b45d01871378 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:29.416879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a8a7a-5a43-498c-abae-b45d01871378 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:29.417155 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a8a7a-5a43-498c-abae-b45d01871378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:29.493531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-013a8a7a-5a43-498c-abae-b45d01871378 None None] MFA Rules not processed for user `59ec1b2a49264e4e9218b65f9ff114b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:29.494741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-013a8a7a-5a43-498c-abae-b45d01871378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:29.514889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:29.570449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 575/1151] 10.222.0.23 () {58 vars in 1059 bytes} [Fri Oct 21 21:15:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:15:29.578726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8c3f6-619d-4077-ae12-f82968b551b8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:15:29.580269 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-36b8c3f6-619d-4077-ae12-f82968b551b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:29.680980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8c3f6-619d-4077-ae12-f82968b551b8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:15:29.752509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc557b7-a2e0-463d-a30a-1a881fb163bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec1b2a49264e4e9218b65f9ff114b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:15:29.753044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc557b7-a2e0-463d-a30a-1a881fb163bd service glance] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:29.753316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc557b7-a2e0-463d-a30a-1a881fb163bd service glance] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:29.753585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc557b7-a2e0-463d-a30a-1a881fb163bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:29.755159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bcc557b7-a2e0-463d-a30a-1a881fb163bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:29.810768 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:29.864274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc557b7-a2e0-463d-a30a-1a881fb163bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:15:29.866282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc557b7-a2e0-463d-a30a-1a881fb163bd service glance] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:15:29.884194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 577/1152] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:15:32.111761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7909299-30cd-487f-864e-6090755e2847 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:32.112356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7909299-30cd-487f-864e-6090755e2847 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:32.112356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7909299-30cd-487f-864e-6090755e2847 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:32.113656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 576/1153] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:32.118865 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fe576-3813-471a-9428-957e7042c3ab None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:32.119286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fe576-3813-471a-9428-957e7042c3ab None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:32.119465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fe576-3813-471a-9428-957e7042c3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:32.183689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-897fe576-3813-471a-9428-957e7042c3ab None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:32.184801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-897fe576-3813-471a-9428-957e7042c3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:32.279251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 578/1154] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:15:32.551695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7909299-30cd-487f-864e-6090755e2847 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:15:32.553703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b7909299-30cd-487f-864e-6090755e2847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:32.676587 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7909299-30cd-487f-864e-6090755e2847 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:15:32.729056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:32.773987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69afc9-1c02-4408-8c25-d546ae2db7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:15:32.774593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69afc9-1c02-4408-8c25-d546ae2db7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:32.774871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69afc9-1c02-4408-8c25-d546ae2db7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:32.775143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69afc9-1c02-4408-8c25-d546ae2db7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:32.775806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69afc9-1c02-4408-8c25-d546ae2db7a7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:15:32.776899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-ac69afc9-1c02-4408-8c25-d546ae2db7a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:15:32.776899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 21 21:15:32.776899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: Oct 21 21:15:32.778025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69afc9-1c02-4408-8c25-d546ae2db7a7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:15:32.796728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 577/1155] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Oct 21 21:15:32 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:15:34.935232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3c494-cffd-4f48-9f36-2f0dccea19f1 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:34.935838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3c494-cffd-4f48-9f36-2f0dccea19f1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:34.935838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3c494-cffd-4f48-9f36-2f0dccea19f1 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:34.937145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 579/1156] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:34.942396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe04ae6-2d30-4cf7-a17a-a5df5ce083fe None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:34.942834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe04ae6-2d30-4cf7-a17a-a5df5ce083fe None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:34.943539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe04ae6-2d30-4cf7-a17a-a5df5ce083fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:35.009461 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-cfe04ae6-2d30-4cf7-a17a-a5df5ce083fe None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:35.010657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cfe04ae6-2d30-4cf7-a17a-a5df5ce083fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:35.106082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 578/1157] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:15:35.392903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3c494-cffd-4f48-9f36-2f0dccea19f1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:15:35.394626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c4b3c494-cffd-4f48-9f36-2f0dccea19f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:35.404803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:35.541032 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3c494-cffd-4f48-9f36-2f0dccea19f1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:15:35.619088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:35.652239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4f735-3806-4fcc-b94b-ab4ecadbb0a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:15:35.652771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4f735-3806-4fcc-b94b-ab4ecadbb0a0 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:35.653045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4f735-3806-4fcc-b94b-ab4ecadbb0a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:35.653319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4f735-3806-4fcc-b94b-ab4ecadbb0a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:35.654882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d2e4f735-3806-4fcc-b94b-ab4ecadbb0a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:35.742205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4f735-3806-4fcc-b94b-ab4ecadbb0a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:15:35.743796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4f735-3806-4fcc-b94b-ab4ecadbb0a0 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:15:35.761036 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 580/1158] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:15:38.056725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1b63b-9829-418c-8162-434025ae8d80 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:38.057145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1b63b-9829-418c-8162-434025ae8d80 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:38.057277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1b63b-9829-418c-8162-434025ae8d80 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:38.058645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 579/1159] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:38.064001 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac80e2-3727-45bb-9746-e71e3f870913 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:38.064452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac80e2-3727-45bb-9746-e71e3f870913 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:38.064557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac80e2-3727-45bb-9746-e71e3f870913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:38.129410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a8ac80e2-3727-45bb-9746-e71e3f870913 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:38.131182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a8ac80e2-3727-45bb-9746-e71e3f870913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:38.176259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:38.226538 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 581/1160] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:15:38.516463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1b63b-9829-418c-8162-434025ae8d80 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:15:38.518017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f6a1b63b-9829-418c-8162-434025ae8d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:38.541131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:38.621036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1b63b-9829-418c-8162-434025ae8d80 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:15:38.693895 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552de36-f501-4c2c-b66a-dc5dfaf0741a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:15:38.694502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552de36-f501-4c2c-b66a-dc5dfaf0741a service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:38.694777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552de36-f501-4c2c-b66a-dc5dfaf0741a service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:38.695047 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552de36-f501-4c2c-b66a-dc5dfaf0741a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:38.696915 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e552de36-f501-4c2c-b66a-dc5dfaf0741a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:38.770722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:38.805681 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552de36-f501-4c2c-b66a-dc5dfaf0741a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:15:38.807123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552de36-f501-4c2c-b66a-dc5dfaf0741a service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:15:38.826215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 580/1161] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:15:41.003594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d127cf7-a0a0-4d07-af91-31aadddee654 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:41.004151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d127cf7-a0a0-4d07-af91-31aadddee654 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:41.004151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d127cf7-a0a0-4d07-af91-31aadddee654 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:41.005688 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 582/1162] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:41.010831 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d29b2-8be9-492c-9f8e-be0de35d64a3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:41.011303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d29b2-8be9-492c-9f8e-be0de35d64a3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:41.011401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d29b2-8be9-492c-9f8e-be0de35d64a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:41.076770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-272d29b2-8be9-492c-9f8e-be0de35d64a3 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:41.077969 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-272d29b2-8be9-492c-9f8e-be0de35d64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:41.172615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 581/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:15:41.462233 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d127cf7-a0a0-4d07-af91-31aadddee654 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:15:41.463834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5d127cf7-a0a0-4d07-af91-31aadddee654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:41.565064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d127cf7-a0a0-4d07-af91-31aadddee654 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:15:41.636197 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:41.637941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cc30a-4236-4e7d-a99d-ff71fe1670e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:15:41.638579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc30a-4236-4e7d-a99d-ff71fe1670e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:41.638975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc30a-4236-4e7d-a99d-ff71fe1670e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:41.639263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc30a-4236-4e7d-a99d-ff71fe1670e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:41.641382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b21cc30a-4236-4e7d-a99d-ff71fe1670e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:41.750395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cc30a-4236-4e7d-a99d-ff71fe1670e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:15:41.751765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cc30a-4236-4e7d-a99d-ff71fe1670e4 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:15:41.768999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 583/1164] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:15:44.006203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d74687-f54d-483d-b163-1993e7082e71 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:44.006703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d74687-f54d-483d-b163-1993e7082e71 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:44.006794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d74687-f54d-483d-b163-1993e7082e71 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:44.008151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 582/1165] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:44.013459 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507bf0-170e-4f64-bac7-6a19cd31eb40 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:44.013901 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507bf0-170e-4f64-bac7-6a19cd31eb40 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:44.013997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b507bf0-170e-4f64-bac7-6a19cd31eb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:44.082556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6b507bf0-170e-4f64-bac7-6a19cd31eb40 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:44.084360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6b507bf0-170e-4f64-bac7-6a19cd31eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:44.136094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:44.180869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 584/1166] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:15:44.475647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d74687-f54d-483d-b163-1993e7082e71 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:15:44.477183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-54d74687-f54d-483d-b163-1993e7082e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:44.512828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:44.580359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d74687-f54d-483d-b163-1993e7082e71 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:15:44.656022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e14de-1820-483a-8b28-1a6bd5973e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:15:44.656621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e14de-1820-483a-8b28-1a6bd5973e42 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:44.656898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e14de-1820-483a-8b28-1a6bd5973e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:44.657165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e14de-1820-483a-8b28-1a6bd5973e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:44.658736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1f2e14de-1820-483a-8b28-1a6bd5973e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:44.737493 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:44.766484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e14de-1820-483a-8b28-1a6bd5973e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:15:44.767865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e14de-1820-483a-8b28-1a6bd5973e42 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:15:44.786214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 583/1167] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:15:47.113421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a86a7-b905-48b5-a242-86ef32f26b0b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:47.113931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a86a7-b905-48b5-a242-86ef32f26b0b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:47.114029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a86a7-b905-48b5-a242-86ef32f26b0b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:47.115915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 585/1168] 10.222.0.23 () {54 vars in 927 bytes} [Fri Oct 21 21:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:15:47.121308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9424-a8eb-40d5-9b35-ae5c7cfcf389 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:47.121755 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9424-a8eb-40d5-9b35-ae5c7cfcf389 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:47.121866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9424-a8eb-40d5-9b35-ae5c7cfcf389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:47.186771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f90e9424-a8eb-40d5-9b35-ae5c7cfcf389 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:15:47.188000 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f90e9424-a8eb-40d5-9b35-ae5c7cfcf389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:47.283353 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 584/1169] 10.222.0.23 () {58 vars in 1024 bytes} [Fri Oct 21 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:15:47.574719 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a86a7-b905-48b5-a242-86ef32f26b0b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:15:47.576293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-470a86a7-b905-48b5-a242-86ef32f26b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:47.679808 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a86a7-b905-48b5-a242-86ef32f26b0b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:15:47.751717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5622a5-4ceb-4a66-8086-524a9cf6e372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:15:47.752320 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5622a5-4ceb-4a66-8086-524a9cf6e372 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:15:47.752594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5622a5-4ceb-4a66-8086-524a9cf6e372 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:15:47.752867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5622a5-4ceb-4a66-8086-524a9cf6e372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:15:47.754448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8a5622a5-4ceb-4a66-8086-524a9cf6e372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:15:47.763627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:47.866655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5622a5-4ceb-4a66-8086-524a9cf6e372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:15:47.868062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5622a5-4ceb-4a66-8086-524a9cf6e372 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:15:47.886977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 586/1170] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:15:57.281769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=82 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:15:57.884628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=50 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:18.795776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157a9c-eb81-4d8a-9a8c-51c4a1abcbce None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:18.796364 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157a9c-eb81-4d8a-9a8c-51c4a1abcbce None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:18.796364 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157a9c-eb81-4d8a-9a8c-51c4a1abcbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:18.872494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5e157a9c-eb81-4d8a-9a8c-51c4a1abcbce None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:17:18.873726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5e157a9c-eb81-4d8a-9a8c-51c4a1abcbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:18.967677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 585/1171] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:17:18.976075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7dfbf-c32f-4bd9-93c9-21e648ea627f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:18.976575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7dfbf-c32f-4bd9-93c9-21e648ea627f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:18.976678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7dfbf-c32f-4bd9-93c9-21e648ea627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:19.050547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-faf7dfbf-c32f-4bd9-93c9-21e648ea627f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:17:19.051695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-faf7dfbf-c32f-4bd9-93c9-21e648ea627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:19.147232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 587/1172] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:17:19.151850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157a9c-eb81-4d8a-9a8c-51c4a1abcbce None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:17:19.153084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5e157a9c-eb81-4d8a-9a8c-51c4a1abcbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:19.165022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157a9c-eb81-4d8a-9a8c-51c4a1abcbce None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:17:19.227070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:19.261070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:17:19.261674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:19.261954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:19.262230 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:19.262867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:17:19.263168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:17:19.264212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:17:19.264212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 21 21:17:19.264212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: Oct 21 21:17:19.265097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:17:19.277195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 586/1173] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:17:19.286585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7dfbf-c32f-4bd9-93c9-21e648ea627f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:17:19.296361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7dfbf-c32f-4bd9-93c9-21e648ea627f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:17:19.360427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:19.395961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28984b-f0c6-46c3-ba1e-61d582ef0f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:17:19.396569 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28984b-f0c6-46c3-ba1e-61d582ef0f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:19.397377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28984b-f0c6-46c3-ba1e-61d582ef0f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:19.397644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28984b-f0c6-46c3-ba1e-61d582ef0f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:19.398264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28984b-f0c6-46c3-ba1e-61d582ef0f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:17:19.399416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-9e28984b-f0c6-46c3-ba1e-61d582ef0f8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:17:19.399416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 21 21:17:19.399416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: Oct 21 21:17:19.400596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28984b-f0c6-46c3-ba1e-61d582ef0f8c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:17:19.455244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 588/1174] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:17:19 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:17:19.460104 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:17:19.461770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:19.494912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696792f-b0a7-409c-81b5-c4fc4698dd7d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:17:19.588065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42d06e-a768-44fa-8df2-36204575eaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:17:19.588668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42d06e-a768-44fa-8df2-36204575eaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:19.588948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42d06e-a768-44fa-8df2-36204575eaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:19.589221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42d06e-a768-44fa-8df2-36204575eaa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:19.589885 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42d06e-a768-44fa-8df2-36204575eaa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:17:19.590907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-5a42d06e-a768-44fa-8df2-36204575eaa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:17:19.590907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 21 21:17:19.590907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: Oct 21 21:17:19.592172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42d06e-a768-44fa-8df2-36204575eaa5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:17:19.633717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 587/1175] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:17:19 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:17:19.637844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28984b-f0c6-46c3-ba1e-61d582ef0f8c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:17:19.639427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9e28984b-f0c6-46c3-ba1e-61d582ef0f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:19.700713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28984b-f0c6-46c3-ba1e-61d582ef0f8c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:17:19.783296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:19.794878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0c5fc-5cee-49e3-b32a-0e170bebab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:17:19.795515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0c5fc-5cee-49e3-b32a-0e170bebab33 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:19.795791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0c5fc-5cee-49e3-b32a-0e170bebab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:19.796063 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0c5fc-5cee-49e3-b32a-0e170bebab33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:19.796773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0c5fc-5cee-49e3-b32a-0e170bebab33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:17:19.798512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0c5fc-5cee-49e3-b32a-0e170bebab33 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:17:19.811727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 589/1176] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:17:19.815757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42d06e-a768-44fa-8df2-36204575eaa5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:17:19.817303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5a42d06e-a768-44fa-8df2-36204575eaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:19.829328 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42d06e-a768-44fa-8df2-36204575eaa5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:17:19.854488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:19.922691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cb64b-71b6-429f-9822-21bb31e26c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:17:19.923333 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cb64b-71b6-429f-9822-21bb31e26c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:19.923617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cb64b-71b6-429f-9822-21bb31e26c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:19.923886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cb64b-71b6-429f-9822-21bb31e26c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:19.924515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cb64b-71b6-429f-9822-21bb31e26c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:17:19.926097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cb64b-71b6-429f-9822-21bb31e26c47 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:17:19.938690 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 588/1177] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:17:19.942945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0c5fc-5cee-49e3-b32a-0e170bebab33 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:17:19.945166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-72b0c5fc-5cee-49e3-b32a-0e170bebab33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:19.977866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0c5fc-5cee-49e3-b32a-0e170bebab33 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:17:20.071880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bc910-9589-42e9-8802-97c63da2b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:17:20.072545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc910-9589-42e9-8802-97c63da2b528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:20.072821 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc910-9589-42e9-8802-97c63da2b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:20.073094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc910-9589-42e9-8802-97c63da2b528 admin admin] PATH_INFO: `/v3/projects/b6a408aeac414b4fadb72a8e9089e617/users/1d472d0f3abe4a7ba3554623851bc1ad/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:20.095346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bc910-9589-42e9-8802-97c63da2b528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a408aeac414b4fadb72a8e9089e617, user_id=1d472d0f3abe4a7ba3554623851bc1ad, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:17:20.097995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bc910-9589-42e9-8802-97c63da2b528 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:17:20.122082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 590/1178] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:17:19 2022] PUT /identity/v3/projects/b6a408aeac414b4fadb72a8e9089e617/users/1d472d0f3abe4a7ba3554623851bc1ad/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:17:20.133746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1a289-05ce-41f1-9b7c-3de5e122aafe None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:20.134203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1a289-05ce-41f1-9b7c-3de5e122aafe None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:20.134580 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1a289-05ce-41f1-9b7c-3de5e122aafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:20.190398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-79d1a289-05ce-41f1-9b7c-3de5e122aafe None None] MFA Rules not processed for user `1d472d0f3abe4a7ba3554623851bc1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:17:20.191555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-79d1a289-05ce-41f1-9b7c-3de5e122aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:20.267709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 589/1179] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:17:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:17:20.280588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7b592-76a3-4277-a38e-e87442fbd885 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:20.280878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7b592-76a3-4277-a38e-e87442fbd885 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:20.281152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7b592-76a3-4277-a38e-e87442fbd885 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:20.282567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 591/1180] 10.222.0.23 () {54 vars in 963 bytes} [Fri Oct 21 21:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:17:20.287968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b578c5-e184-4bbd-b8f4-29689cc0d39b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:20.288255 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b578c5-e184-4bbd-b8f4-29689cc0d39b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:20.288533 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b578c5-e184-4bbd-b8f4-29689cc0d39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:20.320081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:20.366296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-51b578c5-e184-4bbd-b8f4-29689cc0d39b None None] MFA Rules not processed for user `31f812676e6f4b258f556d5a0b54dc46`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:17:20.367513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-51b578c5-e184-4bbd-b8f4-29689cc0d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:20.441323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 590/1181] 10.222.0.23 () {58 vars in 1060 bytes} [Fri Oct 21 21:17:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:17:20.449361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7b592-76a3-4277-a38e-e87442fbd885 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:17:20.450893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-05c7b592-76a3-4277-a38e-e87442fbd885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:20.499871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:20.552886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7b592-76a3-4277-a38e-e87442fbd885 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:17:20.625649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2be5d-ddf7-487c-a2fc-61d6894cd9b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:17:20.626259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2be5d-ddf7-487c-a2fc-61d6894cd9b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:20.626544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2be5d-ddf7-487c-a2fc-61d6894cd9b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:20.626819 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2be5d-ddf7-487c-a2fc-61d6894cd9b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:20.628448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e6f2be5d-ddf7-487c-a2fc-61d6894cd9b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:20.728166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2be5d-ddf7-487c-a2fc-61d6894cd9b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:17:20.729524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2be5d-ddf7-487c-a2fc-61d6894cd9b6 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:17:20.733022 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:20.747857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 592/1182] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:17:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:17:20.793619 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30892-c6a4-454d-9b95-43da64747956 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:20.793906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30892-c6a4-454d-9b95-43da64747956 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:20.794184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a30892-c6a4-454d-9b95-43da64747956 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:20.795496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 591/1183] 10.222.0.23 () {52 vars in 830 bytes} [Fri Oct 21 21:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:17:20.799488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2be5d-ddf7-487c-a2fc-61d6894cd9b6 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:17:20.800695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e6f2be5d-ddf7-487c-a2fc-61d6894cd9b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:20.898165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2be5d-ddf7-487c-a2fc-61d6894cd9b6 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:17:20.989447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:17:20.990042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:20.990265 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:20.990566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] PATH_INFO: `/v3/users/1d472d0f3abe4a7ba3554623851bc1ad` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:21.004961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d472d0f3abe4a7ba3554623851bc1ad)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:17:21.005975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:17:21.005975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 21 21:17:21.005975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: Oct 21 21:17:21.007215 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:17:21.017070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:21.076057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d472d0f3abe4a7ba3554623851bc1ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:17:21.076613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d472d0f3abe4a7ba3554623851bc1ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:17:21.086075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d472d0f3abe4a7ba3554623851bc1ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:17:21.100226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d472d0f3abe4a7ba3554623851bc1ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:17:21.100682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d472d0f3abe4a7ba3554623851bc1ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:17:21.130321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 593/1184] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:17:20 2022] DELETE /identity/v3/users/1d472d0f3abe4a7ba3554623851bc1ad => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:17:21.135789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a568947-a69a-408c-84b4-1a08ad3e42d1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:21.136571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a568947-a69a-408c-84b4-1a08ad3e42d1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:21.136759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a568947-a69a-408c-84b4-1a08ad3e42d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:21.192393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2a568947-a69a-408c-84b4-1a08ad3e42d1 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:17:21.194073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2a568947-a69a-408c-84b4-1a08ad3e42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:21.269279 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:21.282344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 592/1185] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:17:21.292069 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:17:21.293292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:21.394792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2c10c-116e-4026-b9c7-a8b47ab109c4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:17:21.449511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:21.469200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182c939-f074-4dc9-9d94-ff013a11d9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:17:21.469810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182c939-f074-4dc9-9d94-ff013a11d9dd service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:21.470089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182c939-f074-4dc9-9d94-ff013a11d9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:21.470357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182c939-f074-4dc9-9d94-ff013a11d9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:21.471994 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8182c939-f074-4dc9-9d94-ff013a11d9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:21.578126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182c939-f074-4dc9-9d94-ff013a11d9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:17:21.579512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182c939-f074-4dc9-9d94-ff013a11d9dd service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:17:21.597419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 594/1186] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:17:21.972710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a568947-a69a-408c-84b4-1a08ad3e42d1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:17:21.973983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2a568947-a69a-408c-84b4-1a08ad3e42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:17:21.987349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a568947-a69a-408c-84b4-1a08ad3e42d1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:17:22.083907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:17:22.085175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:17:22.085451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:17:22.085719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] PATH_INFO: `/v3/projects/b6a408aeac414b4fadb72a8e9089e617` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:17:22.095597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a408aeac414b4fadb72a8e9089e617)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:17:22.096556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:17:22.096556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 21 21:17:22.096556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: Oct 21 21:17:22.097737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:17:22.154242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a408aeac414b4fadb72a8e9089e617', 'request_id': 'req-5941a3a9-6eb3-4a05-9737-615a7bc451fc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:17:22.164577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a408aeac414b4fadb72a8e9089e617', 'request_id': 'req-5941a3a9-6eb3-4a05-9737-615a7bc451fc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:17:22.171453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a408aeac414b4fadb72a8e9089e617', 'request_id': 'req-5941a3a9-6eb3-4a05-9737-615a7bc451fc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:17:22.202455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] The token cache is being invalidate because project b6a408aeac414b4fadb72a8e9089e617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:17:22.202740 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:17:22.203277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5941a3a9-6eb3-4a05-9737-615a7bc451fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:17:22.204620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 593/1187] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:17:21 2022] DELETE /identity/v3/projects/b6a408aeac414b4fadb72a8e9089e617 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:17:31.595170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=62 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:17:32.200515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:18:53.978101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18003e9-49d7-49de-84ca-0f1a88dffe73 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:18:53.978708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18003e9-49d7-49de-84ca-0f1a88dffe73 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:18:53.978708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18003e9-49d7-49de-84ca-0f1a88dffe73 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:18:53.980123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 595/1188] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:18:53.984834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dd791-db52-42a1-b6f0-271d1d236658 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:18:53.985234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dd791-db52-42a1-b6f0-271d1d236658 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:18:53.985379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dd791-db52-42a1-b6f0-271d1d236658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:18:54.066021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f16dd791-db52-42a1-b6f0-271d1d236658 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:18:54.067243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f16dd791-db52-42a1-b6f0-271d1d236658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:18:54.170408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 594/1189] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:18:54.324753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18003e9-49d7-49de-84ca-0f1a88dffe73 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:18:54.327114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f18003e9-49d7-49de-84ca-0f1a88dffe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:18:54.443805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18003e9-49d7-49de-84ca-0f1a88dffe73 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:18:54.449263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a992dd5-7347-4dc6-98f8-bad094858457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:18:54.449866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a992dd5-7347-4dc6-98f8-bad094858457 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:18:54.450397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a992dd5-7347-4dc6-98f8-bad094858457 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:18:54.450670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a992dd5-7347-4dc6-98f8-bad094858457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:18:54.458633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a992dd5-7347-4dc6-98f8-bad094858457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:18:54.460305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a992dd5-7347-4dc6-98f8-bad094858457 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:18:54.469581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 596/1190] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:18:55.534937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ec19-5b72-465d-a798-acf592563b0a None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:18:55.535557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ec19-5b72-465d-a798-acf592563b0a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:18:55.535557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ec19-5b72-465d-a798-acf592563b0a None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:18:55.536883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 595/1191] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:18:55.542945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082b59-0b8d-4ade-87c7-3afbbc781950 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:18:55.543380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082b59-0b8d-4ade-87c7-3afbbc781950 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:18:55.543529 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082b59-0b8d-4ade-87c7-3afbbc781950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:18:55.562827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ac082b59-0b8d-4ade-87c7-3afbbc781950 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:18:55.564057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ac082b59-0b8d-4ade-87c7-3afbbc781950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:18:55.572506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 597/1192] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:18:55.721862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55ec19-5b72-465d-a798-acf592563b0a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:18:55.740185 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55ec19-5b72-465d-a798-acf592563b0a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:18:55.746986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6162a4d-fdcb-40eb-9433-3fd3a2aa16c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:18:55.747645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6162a4d-fdcb-40eb-9433-3fd3a2aa16c1 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:18:55.747972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6162a4d-fdcb-40eb-9433-3fd3a2aa16c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:18:55.748241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6162a4d-fdcb-40eb-9433-3fd3a2aa16c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:18:55.756883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6162a4d-fdcb-40eb-9433-3fd3a2aa16c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:18:55.758467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6162a4d-fdcb-40eb-9433-3fd3a2aa16c1 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:18:55.767625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 596/1193] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:18:55.815942 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eeeaf-89f1-4a78-a3f7-746360d49919 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:18:55.816238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eeeaf-89f1-4a78-a3f7-746360d49919 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:18:55.816514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eeeaf-89f1-4a78-a3f7-746360d49919 None None] PATH_INFO: `/v3` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:18:55.817938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 598/1194] 10.222.0.42 () {54 vars in 925 bytes} [Fri Oct 21 21:18:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:18:55.826176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf945-65c2-4225-928c-c9b308431a7e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:18:55.826492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf945-65c2-4225-928c-c9b308431a7e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:18:55.826710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf945-65c2-4225-928c-c9b308431a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:18:55.892934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-64edf945-65c2-4225-928c-c9b308431a7e None None] MFA Rules not processed for user `aa89e84c708f44c299c728284e33fabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:18:55.894161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-64edf945-65c2-4225-928c-c9b308431a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:18:55.911958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:18:55.967105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 597/1195] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Oct 21 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:19:04.748626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40cae9-38d3-4397-a046-03b91df08556 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:04.749050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40cae9-38d3-4397-a046-03b91df08556 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:04.749156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40cae9-38d3-4397-a046-03b91df08556 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:04.750530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 599/1196] 10.222.0.23 () {54 vars in 961 bytes} [Fri Oct 21 21:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:19:04.756276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff352b-7c87-4edf-b812-5205cb4dacc7 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:04.756691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff352b-7c87-4edf-b812-5205cb4dacc7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:04.756831 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff352b-7c87-4edf-b812-5205cb4dacc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:04.776376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d0ff352b-7c87-4edf-b812-5205cb4dacc7 None None] MFA Rules not processed for user `aa89e84c708f44c299c728284e33fabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:19:04.777583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d0ff352b-7c87-4edf-b812-5205cb4dacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:19:04.786038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 598/1197] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Oct 21 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:19:04.794139 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40cae9-38d3-4397-a046-03b91df08556 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:19:04.808730 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40cae9-38d3-4397-a046-03b91df08556 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:19:04.813613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bca2f-aca8-4f5a-9449-2bca6da660f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa89e84c708f44c299c728284e33fabf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:19:04.814202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bca2f-aca8-4f5a-9449-2bca6da660f6 service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:04.814477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bca2f-aca8-4f5a-9449-2bca6da660f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:04.814748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bca2f-aca8-4f5a-9449-2bca6da660f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:04.822805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bca2f-aca8-4f5a-9449-2bca6da660f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:19:04.824400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bca2f-aca8-4f5a-9449-2bca6da660f6 service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:19:04.834027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 600/1198] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:19:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:19:07.255837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b845c-568f-41a4-abc8-55b61539f47a None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:07.256441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b845c-568f-41a4-abc8-55b61539f47a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:07.256441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b845c-568f-41a4-abc8-55b61539f47a None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:07.257717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 599/1199] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:19:07.264045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f6d7c-72e7-4956-9470-f8c688504ddc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:07.264500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f6d7c-72e7-4956-9470-f8c688504ddc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:07.264798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f6d7c-72e7-4956-9470-f8c688504ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:07.284508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-db4f6d7c-72e7-4956-9470-f8c688504ddc None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:19:07.285692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-db4f6d7c-72e7-4956-9470-f8c688504ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:19:07.294116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 601/1200] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:19:07.446220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b845c-568f-41a4-abc8-55b61539f47a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:19:07.461183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b845c-568f-41a4-abc8-55b61539f47a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:19:07.466513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f43970-e8aa-4f28-b035-8afb32985bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:19:07.467105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43970-e8aa-4f28-b035-8afb32985bd7 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:07.467420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43970-e8aa-4f28-b035-8afb32985bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:07.467696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43970-e8aa-4f28-b035-8afb32985bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:07.476064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f43970-e8aa-4f28-b035-8afb32985bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:19:07.477621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f43970-e8aa-4f28-b035-8afb32985bd7 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:19:07.486919 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 600/1201] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:19:08.540494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c701-98d3-4242-943e-0ea04e31874b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:08.541063 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c701-98d3-4242-943e-0ea04e31874b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:08.541063 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c701-98d3-4242-943e-0ea04e31874b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:08.542422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 602/1202] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 21 21:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:19:08.548670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30563c6-815a-4519-b7be-0b68ce369ab9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:08.549098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30563c6-815a-4519-b7be-0b68ce369ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:08.549223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30563c6-815a-4519-b7be-0b68ce369ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:08.568774 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f30563c6-815a-4519-b7be-0b68ce369ab9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:19:08.569953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f30563c6-815a-4519-b7be-0b68ce369ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:19:08.577918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 601/1203] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 21 21:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:19:08.728623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515c701-98d3-4242-943e-0ea04e31874b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:19:08.742874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515c701-98d3-4242-943e-0ea04e31874b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:19:08.748353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6cd2c-f308-4105-9813-a70e673ccfde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:19:08.748945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6cd2c-f308-4105-9813-a70e673ccfde service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:08.749225 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6cd2c-f308-4105-9813-a70e673ccfde service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:08.749499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6cd2c-f308-4105-9813-a70e673ccfde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:08.757430 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6cd2c-f308-4105-9813-a70e673ccfde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:19:08.758988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6cd2c-f308-4105-9813-a70e673ccfde service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:19:08.768247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 603/1204] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:19:12.731092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465839-9976-4d1b-8a4e-d29b03956548 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:12.731704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465839-9976-4d1b-8a4e-d29b03956548 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:12.731704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465839-9976-4d1b-8a4e-d29b03956548 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:12.733037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 602/1205] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:19:12.738352 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d1cdf-f009-4753-8269-5b2912478bfb None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:12.738755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d1cdf-f009-4753-8269-5b2912478bfb None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:12.738912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d1cdf-f009-4753-8269-5b2912478bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:12.758435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-df1d1cdf-f009-4753-8269-5b2912478bfb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:19:12.759657 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-df1d1cdf-f009-4753-8269-5b2912478bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:19:12.767448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 604/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:19:13.058724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d465839-9976-4d1b-8a4e-d29b03956548 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:19:13.060513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4d465839-9976-4d1b-8a4e-d29b03956548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:19:13.137574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d465839-9976-4d1b-8a4e-d29b03956548 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:19:13.141091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099d1eb-431d-4aee-836c-d3d8c60fdce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:19:13.141687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099d1eb-431d-4aee-836c-d3d8c60fdce6 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:13.141963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099d1eb-431d-4aee-836c-d3d8c60fdce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:13.142235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099d1eb-431d-4aee-836c-d3d8c60fdce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:13.151670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099d1eb-431d-4aee-836c-d3d8c60fdce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:19:13.153138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099d1eb-431d-4aee-836c-d3d8c60fdce6 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:19:13.162420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 603/1207] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:19:15.289521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185088a-0bdb-4c8f-b6b0-e5293a123c31 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:15.290105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185088a-0bdb-4c8f-b6b0-e5293a123c31 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:15.290105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185088a-0bdb-4c8f-b6b0-e5293a123c31 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:15.291445 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 605/1208] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:19:15.296570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476454f-0c78-4c0b-b9e2-48149251b667 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:15.297016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476454f-0c78-4c0b-b9e2-48149251b667 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:15.297120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476454f-0c78-4c0b-b9e2-48149251b667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:15.318212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b476454f-0c78-4c0b-b9e2-48149251b667 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:19:15.319375 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b476454f-0c78-4c0b-b9e2-48149251b667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:19:15.327312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 604/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:19:15.617675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185088a-0bdb-4c8f-b6b0-e5293a123c31 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:19:15.628278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185088a-0bdb-4c8f-b6b0-e5293a123c31 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:19:15.631741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04f067-b84f-4af0-9128-3779833000ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:19:15.632327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04f067-b84f-4af0-9128-3779833000ae service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:15.632604 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04f067-b84f-4af0-9128-3779833000ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:15.632874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04f067-b84f-4af0-9128-3779833000ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:15.641413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04f067-b84f-4af0-9128-3779833000ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:19:15.642804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04f067-b84f-4af0-9128-3779833000ae service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:19:15.652477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 606/1210] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:19:19.182876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1793d-8bfa-4275-a870-d98886de98db None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:19.183444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1793d-8bfa-4275-a870-d98886de98db None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:19.183546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1793d-8bfa-4275-a870-d98886de98db None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:19.184850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 605/1211] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:19:19.189912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d22d4-19c0-4638-a4c7-2f6bc8c9badf None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:19.190334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d22d4-19c0-4638-a4c7-2f6bc8c9badf None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:19.190465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d22d4-19c0-4638-a4c7-2f6bc8c9badf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:19.210487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1f7d22d4-19c0-4638-a4c7-2f6bc8c9badf None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:19:19.211711 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1f7d22d4-19c0-4638-a4c7-2f6bc8c9badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:19:19.219496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 607/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:19:19.521330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1793d-8bfa-4275-a870-d98886de98db None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:19:19.522983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-09a1793d-8bfa-4275-a870-d98886de98db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:19:19.586738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:19:19.601305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1793d-8bfa-4275-a870-d98886de98db None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:19:19.604971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e380316-f132-40ff-9a8b-f2922f1c47f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:19:19.605583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380316-f132-40ff-9a8b-f2922f1c47f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:19.605863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380316-f132-40ff-9a8b-f2922f1c47f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:19.606137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380316-f132-40ff-9a8b-f2922f1c47f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:19.615769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e380316-f132-40ff-9a8b-f2922f1c47f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:19:19.617188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e380316-f132-40ff-9a8b-f2922f1c47f9 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:19:19.626456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 606/1213] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:19:21.750862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a8cae-61e7-4a03-89d3-0116967f956b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:21.751459 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a8cae-61e7-4a03-89d3-0116967f956b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:21.751459 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a8cae-61e7-4a03-89d3-0116967f956b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:21.752792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 608/1214] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 21 21:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:19:21.758696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5622ae-1424-4f37-87bd-a5c3ee18f493 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:21.759098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5622ae-1424-4f37-87bd-a5c3ee18f493 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:21.759249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5622ae-1424-4f37-87bd-a5c3ee18f493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:21.779053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7e5622ae-1424-4f37-87bd-a5c3ee18f493 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:19:21.780298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7e5622ae-1424-4f37-87bd-a5c3ee18f493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:19:21.787949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 607/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 21 21:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:19:22.090047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a8cae-61e7-4a03-89d3-0116967f956b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:19:22.091748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e47a8cae-61e7-4a03-89d3-0116967f956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:19:22.099383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=84 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:19:22.105684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a8cae-61e7-4a03-89d3-0116967f956b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:19:22.109217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099adae-bcc0-439b-8bcd-29e6828e6044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:19:22.109812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099adae-bcc0-439b-8bcd-29e6828e6044 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:19:22.110091 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099adae-bcc0-439b-8bcd-29e6828e6044 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:19:22.110363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099adae-bcc0-439b-8bcd-29e6828e6044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:19:22.119008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099adae-bcc0-439b-8bcd-29e6828e6044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:19:22.120449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099adae-bcc0-439b-8bcd-29e6828e6044 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:19:22.129625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 609/1216] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:19:31.774199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=11 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:19:32.125572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:49.818713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325c1ce-0bd7-4094-b1b0-af4f97e382b5 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:49.819414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325c1ce-0bd7-4094-b1b0-af4f97e382b5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:49.819414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325c1ce-0bd7-4094-b1b0-af4f97e382b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:49.850306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8325c1ce-0bd7-4094-b1b0-af4f97e382b5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:49.855605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8325c1ce-0bd7-4094-b1b0-af4f97e382b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:49.864494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 608/1217] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:49.874864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5a9a-404f-43e5-ba49-c1b543bb5a6c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:49.875458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5a9a-404f-43e5-ba49-c1b543bb5a6c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:49.875458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5a9a-404f-43e5-ba49-c1b543bb5a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:49.906533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-74ca5a9a-404f-43e5-ba49-c1b543bb5a6c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:49.907770 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-74ca5a9a-404f-43e5-ba49-c1b543bb5a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:49.920250 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 610/1218] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:49.924407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325c1ce-0bd7-4094-b1b0-af4f97e382b5 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:49.941696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325c1ce-0bd7-4094-b1b0-af4f97e382b5 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:49.946959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbe148-8e03-4ed0-a1c9-a17170130394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:49.947921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe148-8e03-4ed0-a1c9-a17170130394 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:49.948529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe148-8e03-4ed0-a1c9-a17170130394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:49.948977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe148-8e03-4ed0-a1c9-a17170130394 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:49.949948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbe148-8e03-4ed0-a1c9-a17170130394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:20:49.950422 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbe148-8e03-4ed0-a1c9-a17170130394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:49.952545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbe148-8e03-4ed0-a1c9-a17170130394 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:49.974941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 609/1219] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:20:49.983570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca5a9a-404f-43e5-ba49-c1b543bb5a6c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:49.995227 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca5a9a-404f-43e5-ba49-c1b543bb5a6c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.003709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314d8d0-1bf9-42c2-9e38-a59a9d9d8dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.004332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314d8d0-1bf9-42c2-9e38-a59a9d9d8dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.004616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314d8d0-1bf9-42c2-9e38-a59a9d9d8dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.004952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314d8d0-1bf9-42c2-9e38-a59a9d9d8dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.005600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314d8d0-1bf9-42c2-9e38-a59a9d9d8dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.007547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314d8d0-1bf9-42c2-9e38-a59a9d9d8dc3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.063809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9488f4-54d5-4362-ad11-e19ab31c9ed5 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.064388 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9488f4-54d5-4362-ad11-e19ab31c9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.065561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9488f4-54d5-4362-ad11-e19ab31c9ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.093331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 611/1220] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:20:49 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:50.102808 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314d8d0-1bf9-42c2-9e38-a59a9d9d8dc3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.112042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7b9488f4-54d5-4362-ad11-e19ab31c9ed5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.113437 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7b9488f4-54d5-4362-ad11-e19ab31c9ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.243383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314d8d0-1bf9-42c2-9e38-a59a9d9d8dc3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.252013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 610/1221] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.254649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354ea4-348f-4150-83e1-aa6f0b805d0e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.256097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354ea4-348f-4150-83e1-aa6f0b805d0e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.256789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354ea4-348f-4150-83e1-aa6f0b805d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.257632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c7ea9-051d-40e0-8af9-19c2e6e22640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.260503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c7ea9-051d-40e0-8af9-19c2e6e22640 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.261022 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c7ea9-051d-40e0-8af9-19c2e6e22640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.261528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c7ea9-051d-40e0-8af9-19c2e6e22640 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.262435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c7ea9-051d-40e0-8af9-19c2e6e22640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.268910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-af4c7ea9-051d-40e0-8af9-19c2e6e22640 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:20:50.268910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 21 21:20:50.268910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: Oct 21 21:20:50.271056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c7ea9-051d-40e0-8af9-19c2e6e22640 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.308801 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-cb354ea4-348f-4150-83e1-aa6f0b805d0e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.310764 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cb354ea4-348f-4150-83e1-aa6f0b805d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.323612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 612/1222] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:50.324704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 611/1223] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.326187 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de5da-de2d-416f-a5d2-593dd9a9c2df None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.326482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de5da-de2d-416f-a5d2-593dd9a9c2df None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.327122 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de5da-de2d-416f-a5d2-593dd9a9c2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.328161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354ea4-348f-4150-83e1-aa6f0b805d0e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.347693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354ea4-348f-4150-83e1-aa6f0b805d0e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.364782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d69de5da-de2d-416f-a5d2-593dd9a9c2df None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.365465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91051522-42dc-40a5-9726-9db80caa90e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.366212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d69de5da-de2d-416f-a5d2-593dd9a9c2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.366606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91051522-42dc-40a5-9726-9db80caa90e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.367102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91051522-42dc-40a5-9726-9db80caa90e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.367621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91051522-42dc-40a5-9726-9db80caa90e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.368514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91051522-42dc-40a5-9726-9db80caa90e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.370460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91051522-42dc-40a5-9726-9db80caa90e0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.385135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 613/1224] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.386748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4e746-5758-4d38-a6d4-1419a7f3731b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.387048 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4e746-5758-4d38-a6d4-1419a7f3731b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.387306 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4e746-5758-4d38-a6d4-1419a7f3731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.390997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 612/1225] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:20:50.392298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91051522-42dc-40a5-9726-9db80caa90e0 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.409112 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91051522-42dc-40a5-9726-9db80caa90e0 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.421436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef9062-6e5c-4891-b284-586732d30879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.422496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9062-6e5c-4891-b284-586732d30879 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.422997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9062-6e5c-4891-b284-586732d30879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.423538 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9062-6e5c-4891-b284-586732d30879 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.424460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef9062-6e5c-4891-b284-586732d30879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:20:50.424983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef9062-6e5c-4891-b284-586732d30879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.425868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1bf4e746-5758-4d38-a6d4-1419a7f3731b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.427038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef9062-6e5c-4891-b284-586732d30879 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.427259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1bf4e746-5758-4d38-a6d4-1419a7f3731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.446697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 613/1226] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:20:50.447623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 614/1227] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.448429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef9062-6e5c-4891-b284-586732d30879 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.457337 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4e746-5758-4d38-a6d4-1419a7f3731b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.466425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef9062-6e5c-4891-b284-586732d30879 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.471677 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4e746-5758-4d38-a6d4-1419a7f3731b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.481568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d765102-7d49-45a4-bd43-24d013dda466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.482475 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765102-7d49-45a4-bd43-24d013dda466 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.482985 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765102-7d49-45a4-bd43-24d013dda466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.483515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765102-7d49-45a4-bd43-24d013dda466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.484395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d765102-7d49-45a4-bd43-24d013dda466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.486213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d765102-7d49-45a4-bd43-24d013dda466 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.488243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383c34d-8125-451e-8407-2ce81a673c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.488881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383c34d-8125-451e-8407-2ce81a673c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.489282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383c34d-8125-451e-8407-2ce81a673c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.489913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383c34d-8125-451e-8407-2ce81a673c62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.490412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383c34d-8125-451e-8407-2ce81a673c62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:20:50.490720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383c34d-8125-451e-8407-2ce81a673c62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.491747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-0383c34d-8125-451e-8407-2ce81a673c62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:20:50.491747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 21 21:20:50.491747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: Oct 21 21:20:50.492629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383c34d-8125-451e-8407-2ce81a673c62 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.505227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 614/1228] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:50.506384 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d765102-7d49-45a4-bd43-24d013dda466 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.511971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 615/1229] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:20:50.513272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b43f-0e38-44ac-8af2-18f660e740c6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.513749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b43f-0e38-44ac-8af2-18f660e740c6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.514030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b43f-0e38-44ac-8af2-18f660e740c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.522589 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d765102-7d49-45a4-bd43-24d013dda466 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.537068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffd103-2352-48b8-9fe8-9afc7533c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.538008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffd103-2352-48b8-9fe8-9afc7533c84e admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.538491 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffd103-2352-48b8-9fe8-9afc7533c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.538977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffd103-2352-48b8-9fe8-9afc7533c84e admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.539865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffd103-2352-48b8-9fe8-9afc7533c84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.541113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-24ffd103-2352-48b8-9fe8-9afc7533c84e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:20:50.541113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 21 21:20:50.541113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: Oct 21 21:20:50.542658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffd103-2352-48b8-9fe8-9afc7533c84e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.555623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-eee1b43f-0e38-44ac-8af2-18f660e740c6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.557051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-eee1b43f-0e38-44ac-8af2-18f660e740c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.578114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 616/1230] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.578831 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b43f-0e38-44ac-8af2-18f660e740c6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.593195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b43f-0e38-44ac-8af2-18f660e740c6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.598979 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 615/1231] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/projects => generated 361 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:50.600064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffd103-2352-48b8-9fe8-9afc7533c84e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.603312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe256fbb-f6e2-4240-891a-fd75945abaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.603570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256fbb-f6e2-4240-891a-fd75945abaee admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.603849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256fbb-f6e2-4240-891a-fd75945abaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.604148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256fbb-f6e2-4240-891a-fd75945abaee admin admin] PATH_INFO: `/v3/projects/e91f5d5bf6c5425aad7c429941ae6aa8/users/84af08afd232473b8c1c83ac3f0dee3d/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.641039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe256fbb-f6e2-4240-891a-fd75945abaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91f5d5bf6c5425aad7c429941ae6aa8, user_id=84af08afd232473b8c1c83ac3f0dee3d, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.647329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe256fbb-f6e2-4240-891a-fd75945abaee admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.676140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 617/1232] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:50 2022] PUT /identity/v3/projects/e91f5d5bf6c5425aad7c429941ae6aa8/users/84af08afd232473b8c1c83ac3f0dee3d/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:50.677406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad358db-7db9-4aed-9e9c-f18f8506bf57 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.677704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad358db-7db9-4aed-9e9c-f18f8506bf57 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.678024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad358db-7db9-4aed-9e9c-f18f8506bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.701180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffd103-2352-48b8-9fe8-9afc7533c84e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.701780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3ad358db-7db9-4aed-9e9c-f18f8506bf57 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.702995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3ad358db-7db9-4aed-9e9c-f18f8506bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.723001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:50.754180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:50.763084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fba75-41db-4a3a-965a-4439e308f6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.763730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fba75-41db-4a3a-965a-4439e308f6bd admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.764005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fba75-41db-4a3a-965a-4439e308f6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.764283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fba75-41db-4a3a-965a-4439e308f6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.764940 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fba75-41db-4a3a-965a-4439e308f6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.766806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 618/1233] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.766924 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fba75-41db-4a3a-965a-4439e308f6bd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.767599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad358db-7db9-4aed-9e9c-f18f8506bf57 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.780129 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad358db-7db9-4aed-9e9c-f18f8506bf57 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.785081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b649d9-e52a-442f-a00c-bdb828f30fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.785685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b649d9-e52a-442f-a00c-bdb828f30fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.785970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b649d9-e52a-442f-a00c-bdb828f30fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.786245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b649d9-e52a-442f-a00c-bdb828f30fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.786875 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b649d9-e52a-442f-a00c-bdb828f30fc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.788874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b649d9-e52a-442f-a00c-bdb828f30fc5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.793221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 616/1234] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:50.794466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38a74-fc44-49f8-8f25-4664607da9ea None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.794752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38a74-fc44-49f8-8f25-4664607da9ea None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.795024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38a74-fc44-49f8-8f25-4664607da9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.810702 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 619/1235] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/users => generated 281 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:50.812105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056471-84f3-4b55-8e09-749a4aefdd2c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.812420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056471-84f3-4b55-8e09-749a4aefdd2c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.812666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056471-84f3-4b55-8e09-749a4aefdd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.820330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ecf38a74-fc44-49f8-8f25-4664607da9ea None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.821548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ecf38a74-fc44-49f8-8f25-4664607da9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.836460 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ac056471-84f3-4b55-8e09-749a4aefdd2c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.837846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ac056471-84f3-4b55-8e09-749a4aefdd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.884691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 617/1236] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.888620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9f211-b645-402c-a90b-47f80fe0b968 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.889024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9f211-b645-402c-a90b-47f80fe0b968 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.889309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9f211-b645-402c-a90b-47f80fe0b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.896741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 620/1237] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.897976 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b65d-9d02-4b6f-aaf8-6047d87e3270 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.898264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b65d-9d02-4b6f-aaf8-6047d87e3270 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.898534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75b65d-9d02-4b6f-aaf8-6047d87e3270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.909720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d8b9f211-b645-402c-a90b-47f80fe0b968 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.910925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d8b9f211-b645-402c-a90b-47f80fe0b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.917293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0d75b65d-9d02-4b6f-aaf8-6047d87e3270 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.918452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0d75b65d-9d02-4b6f-aaf8-6047d87e3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.918886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 618/1238] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.923305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae3260-64ba-4e37-90d7-c3da86a18622 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.923305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae3260-64ba-4e37-90d7-c3da86a18622 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.923305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae3260-64ba-4e37-90d7-c3da86a18622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.933279 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 621/1239] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.933279 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75b65d-9d02-4b6f-aaf8-6047d87e3270 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.941364 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c8ae3260-64ba-4e37-90d7-c3da86a18622 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:50.942556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c8ae3260-64ba-4e37-90d7-c3da86a18622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:50.943677 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75b65d-9d02-4b6f-aaf8-6047d87e3270 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.948156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26230-ecd2-422d-b151-58d50a1c1dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.948771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26230-ecd2-422d-b151-58d50a1c1dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.949045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26230-ecd2-422d-b151-58d50a1c1dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.949313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26230-ecd2-422d-b151-58d50a1c1dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.949978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26230-ecd2-422d-b151-58d50a1c1dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:20:50.950278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26230-ecd2-422d-b151-58d50a1c1dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.950742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 619/1240] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:50.951589 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae3260-64ba-4e37-90d7-c3da86a18622 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.952155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26230-ecd2-422d-b151-58d50a1c1dd8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.964275 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 622/1241] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:20:50.965076 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26230-ecd2-422d-b151-58d50a1c1dd8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:50.965380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae3260-64ba-4e37-90d7-c3da86a18622 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.974109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6694954-a175-4dca-9084-c0b8ab0116ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.974710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694954-a175-4dca-9084-c0b8ab0116ca admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.974983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694954-a175-4dca-9084-c0b8ab0116ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.975255 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694954-a175-4dca-9084-c0b8ab0116ca admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.975918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6694954-a175-4dca-9084-c0b8ab0116ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.978094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6694954-a175-4dca-9084-c0b8ab0116ca admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.979288 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26230-ecd2-422d-b151-58d50a1c1dd8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:50.983760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71cfce-e1c5-44ae-9c53-ff598670c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:50.984348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71cfce-e1c5-44ae-9c53-ff598670c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:50.984626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71cfce-e1c5-44ae-9c53-ff598670c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:50.984896 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71cfce-e1c5-44ae-9c53-ff598670c6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:50.985525 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71cfce-e1c5-44ae-9c53-ff598670c6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:50.987646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71cfce-e1c5-44ae-9c53-ff598670c6fb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:50.999777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 623/1242] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:51.003696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 620/1243] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:51.003852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14458c8d-0dc2-42eb-9b29-f2fc28be52c5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.003852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14458c8d-0dc2-42eb-9b29-f2fc28be52c5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.004041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35afdb-81e0-4f6a-91df-8352be61a2b9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.004145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14458c8d-0dc2-42eb-9b29-f2fc28be52c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.004244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35afdb-81e0-4f6a-91df-8352be61a2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.004244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35afdb-81e0-4f6a-91df-8352be61a2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.023141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8b35afdb-81e0-4f6a-91df-8352be61a2b9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:51.024226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-14458c8d-0dc2-42eb-9b29-f2fc28be52c5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:51.024699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8b35afdb-81e0-4f6a-91df-8352be61a2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:51.025593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-14458c8d-0dc2-42eb-9b29-f2fc28be52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:51.033223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 621/1244] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:51.035071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f2333-1688-41de-9a7a-dd97034a6332 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.035391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f2333-1688-41de-9a7a-dd97034a6332 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.035801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 624/1245] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:51.035932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f2333-1688-41de-9a7a-dd97034a6332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.036750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14458c8d-0dc2-42eb-9b29-f2fc28be52c5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.038262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-14458c8d-0dc2-42eb-9b29-f2fc28be52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:51.056818 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-517f2333-1688-41de-9a7a-dd97034a6332 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:51.058018 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-517f2333-1688-41de-9a7a-dd97034a6332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:51.066628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 622/1246] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:51.067832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b1c6-dbae-4d4f-b496-212fba3729c9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.068115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b1c6-dbae-4d4f-b496-212fba3729c9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.068388 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b1c6-dbae-4d4f-b496-212fba3729c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.088878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4756b1c6-dbae-4d4f-b496-212fba3729c9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:51.090070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4756b1c6-dbae-4d4f-b496-212fba3729c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:51.097996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 623/1247] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:51.098808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b1c6-dbae-4d4f-b496-212fba3729c9 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.102751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14458c8d-0dc2-42eb-9b29-f2fc28be52c5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.106426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91cb71-6e4f-432f-853b-3218daa6c07f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.107035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91cb71-6e4f-432f-853b-3218daa6c07f service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.107341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91cb71-6e4f-432f-853b-3218daa6c07f service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.107612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91cb71-6e4f-432f-853b-3218daa6c07f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.107957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b1c6-dbae-4d4f-b496-212fba3729c9 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.112664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62da4-6484-410f-8d10-0823c0687bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.113264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62da4-6484-410f-8d10-0823c0687bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.113546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62da4-6484-410f-8d10-0823c0687bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.113820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62da4-6484-410f-8d10-0823c0687bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.114857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d62da4-6484-410f-8d10-0823c0687bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.116378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d62da4-6484-410f-8d10-0823c0687bc5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.116644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91cb71-6e4f-432f-853b-3218daa6c07f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.118166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91cb71-6e4f-432f-853b-3218daa6c07f service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.128483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 625/1248] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:51.129467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91cb71-6e4f-432f-853b-3218daa6c07f service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.140221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91cb71-6e4f-432f-853b-3218daa6c07f service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.145846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60d755-6bb1-439c-8d47-3cddf9742ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.146712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60d755-6bb1-439c-8d47-3cddf9742ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.147147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60d755-6bb1-439c-8d47-3cddf9742ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.150735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60d755-6bb1-439c-8d47-3cddf9742ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.150898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 624/1249] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:51.151003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60d755-6bb1-439c-8d47-3cddf9742ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.151102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62da4-6484-410f-8d10-0823c0687bc5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.151200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60d755-6bb1-439c-8d47-3cddf9742ffc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.161784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 626/1250] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:51.163051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60d755-6bb1-439c-8d47-3cddf9742ffc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.173054 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60d755-6bb1-439c-8d47-3cddf9742ffc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.200425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:51.207508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:51.227790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62da4-6484-410f-8d10-0823c0687bc5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.234410 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef559ce-d46d-46a1-b162-082f59124c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.235029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef559ce-d46d-46a1-b162-082f59124c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.235354 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef559ce-d46d-46a1-b162-082f59124c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.235633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef559ce-d46d-46a1-b162-082f59124c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.236274 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef559ce-d46d-46a1-b162-082f59124c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.238026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef559ce-d46d-46a1-b162-082f59124c28 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.241354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b54d1-e120-4cc7-b158-8de3fab3ad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.242131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b54d1-e120-4cc7-b158-8de3fab3ad9f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.242321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b54d1-e120-4cc7-b158-8de3fab3ad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.242619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b54d1-e120-4cc7-b158-8de3fab3ad9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.243328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b54d1-e120-4cc7-b158-8de3fab3ad9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:20:51.243705 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b54d1-e120-4cc7-b158-8de3fab3ad9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.245282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b54d1-e120-4cc7-b158-8de3fab3ad9f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.251798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 625/1251] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:51.253983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef559ce-d46d-46a1-b162-082f59124c28 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.259534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 627/1252] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:20:51.260486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b54d1-e120-4cc7-b158-8de3fab3ad9f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.271515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef559ce-d46d-46a1-b162-082f59124c28 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.271706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b54d1-e120-4cc7-b158-8de3fab3ad9f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.276783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a103d0-df89-4a5d-91c7-8cfa26329a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.277396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a103d0-df89-4a5d-91c7-8cfa26329a6e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.277677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a103d0-df89-4a5d-91c7-8cfa26329a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.277954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a103d0-df89-4a5d-91c7-8cfa26329a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.278609 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a103d0-df89-4a5d-91c7-8cfa26329a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:20:51.279011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a103d0-df89-4a5d-91c7-8cfa26329a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.280735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a103d0-df89-4a5d-91c7-8cfa26329a6e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.287954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1d39-3353-48d0-b051-a5f22a27eb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.288807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1d39-3353-48d0-b051-a5f22a27eb95 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.289257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1d39-3353-48d0-b051-a5f22a27eb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.289733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1d39-3353-48d0-b051-a5f22a27eb95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.290567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c1d39-3353-48d0-b051-a5f22a27eb95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:20:51.291053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c1d39-3353-48d0-b051-a5f22a27eb95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.292914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c1d39-3353-48d0-b051-a5f22a27eb95 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.293859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 626/1253] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:20:51.294696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a103d0-df89-4a5d-91c7-8cfa26329a6e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.311521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a103d0-df89-4a5d-91c7-8cfa26329a6e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.314835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 628/1254] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:20:51.318131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ead3a0-b707-4bd2-a8ca-ee0950afe15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.318835 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ead3a0-b707-4bd2-a8ca-ee0950afe15e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.319195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ead3a0-b707-4bd2-a8ca-ee0950afe15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.319583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ead3a0-b707-4bd2-a8ca-ee0950afe15e admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.320362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ead3a0-b707-4bd2-a8ca-ee0950afe15e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:20:51.320732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ead3a0-b707-4bd2-a8ca-ee0950afe15e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.322397 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ead3a0-b707-4bd2-a8ca-ee0950afe15e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.323763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1d39-3353-48d0-b051-a5f22a27eb95 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.335411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1d39-3353-48d0-b051-a5f22a27eb95 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.342510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47de66-8c4b-49b9-9b8c-de45a3bd8fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.343882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47de66-8c4b-49b9-9b8c-de45a3bd8fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.344409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47de66-8c4b-49b9-9b8c-de45a3bd8fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.344639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47de66-8c4b-49b9-9b8c-de45a3bd8fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.345487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47de66-8c4b-49b9-9b8c-de45a3bd8fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.348315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47de66-8c4b-49b9-9b8c-de45a3bd8fc2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.354321 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 627/1255] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:20:51.355611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ead3a0-b707-4bd2-a8ca-ee0950afe15e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.372743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ead3a0-b707-4bd2-a8ca-ee0950afe15e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.375375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 629/1256] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:51.375375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47de66-8c4b-49b9-9b8c-de45a3bd8fc2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.380697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519260d9-e03e-4f40-a45e-6a8ac13c744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.381367 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519260d9-e03e-4f40-a45e-6a8ac13c744d admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.381654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519260d9-e03e-4f40-a45e-6a8ac13c744d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.381947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519260d9-e03e-4f40-a45e-6a8ac13c744d admin admin] PATH_INFO: `/v3/projects/669d00fd24cd4a8e85b08e0758ab6f4c/users/a0ad98167dcd4eeea98b7e3d56112a22/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.389730 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47de66-8c4b-49b9-9b8c-de45a3bd8fc2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.395320 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fedc61-27b9-4cdd-ba9f-e07853ab34f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.395951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fedc61-27b9-4cdd-ba9f-e07853ab34f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.396232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fedc61-27b9-4cdd-ba9f-e07853ab34f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.396518 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fedc61-27b9-4cdd-ba9f-e07853ab34f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.397154 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fedc61-27b9-4cdd-ba9f-e07853ab34f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.398800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fedc61-27b9-4cdd-ba9f-e07853ab34f5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.399086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519260d9-e03e-4f40-a45e-6a8ac13c744d admin admin] RBAC: Authorizing `identity:create_grant(project_id=669d00fd24cd4a8e85b08e0758ab6f4c, user_id=a0ad98167dcd4eeea98b7e3d56112a22, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.402196 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519260d9-e03e-4f40-a45e-6a8ac13c744d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.410481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 630/1257] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:51.414567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fedc61-27b9-4cdd-ba9f-e07853ab34f5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.418835 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 628/1258] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:51 2022] PUT /identity/v3/projects/669d00fd24cd4a8e85b08e0758ab6f4c/users/a0ad98167dcd4eeea98b7e3d56112a22/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:51.419935 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519260d9-e03e-4f40-a45e-6a8ac13c744d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.433828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fedc61-27b9-4cdd-ba9f-e07853ab34f5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.493499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519260d9-e03e-4f40-a45e-6a8ac13c744d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.494844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5421c2-1b3f-4803-a30a-73cc792f3f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.495586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5421c2-1b3f-4803-a30a-73cc792f3f77 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.495911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5421c2-1b3f-4803-a30a-73cc792f3f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.496251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5421c2-1b3f-4803-a30a-73cc792f3f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.496951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5421c2-1b3f-4803-a30a-73cc792f3f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.498897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5421c2-1b3f-4803-a30a-73cc792f3f77 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.499036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58034e51-e156-4cb2-9705-e036dfdeaaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.499707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58034e51-e156-4cb2-9705-e036dfdeaaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.500057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58034e51-e156-4cb2-9705-e036dfdeaaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.500398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58034e51-e156-4cb2-9705-e036dfdeaaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.501214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58034e51-e156-4cb2-9705-e036dfdeaaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.503743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58034e51-e156-4cb2-9705-e036dfdeaaa8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.535533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 631/1259] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:51.535533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5421c2-1b3f-4803-a30a-73cc792f3f77 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.541849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 629/1260] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:51.542462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58034e51-e156-4cb2-9705-e036dfdeaaa8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.619021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58034e51-e156-4cb2-9705-e036dfdeaaa8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.621541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5421c2-1b3f-4803-a30a-73cc792f3f77 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.624677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f36c1c-d264-4dc5-957d-d480c72bcc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.625301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f36c1c-d264-4dc5-957d-d480c72bcc17 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.625576 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f36c1c-d264-4dc5-957d-d480c72bcc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.625850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f36c1c-d264-4dc5-957d-d480c72bcc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.626474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f36c1c-d264-4dc5-957d-d480c72bcc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.627886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702eab9-bfe1-446c-becb-a69404d1f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.628707 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702eab9-bfe1-446c-becb-a69404d1f4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.628901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f36c1c-d264-4dc5-957d-d480c72bcc17 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.629366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702eab9-bfe1-446c-becb-a69404d1f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.629817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702eab9-bfe1-446c-becb-a69404d1f4e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.630685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702eab9-bfe1-446c-becb-a69404d1f4e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.632851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702eab9-bfe1-446c-becb-a69404d1f4e0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.651153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:51.652140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:51.670670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 632/1261] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:51.671922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702eab9-bfe1-446c-becb-a69404d1f4e0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.674082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 630/1262] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:51.675715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f36c1c-d264-4dc5-957d-d480c72bcc17 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.749960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702eab9-bfe1-446c-becb-a69404d1f4e0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.755733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee0e6-8a9a-4df9-8bd8-f51d536cf0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.756094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f36c1c-d264-4dc5-957d-d480c72bcc17 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.756631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee0e6-8a9a-4df9-8bd8-f51d536cf0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.757076 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee0e6-8a9a-4df9-8bd8-f51d536cf0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.757438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee0e6-8a9a-4df9-8bd8-f51d536cf0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.758131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee0e6-8a9a-4df9-8bd8-f51d536cf0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.760290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee0e6-8a9a-4df9-8bd8-f51d536cf0e6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.763887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47019ff4-01b0-46c2-b3b4-f9a0a5ca9e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.764866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47019ff4-01b0-46c2-b3b4-f9a0a5ca9e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.765314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47019ff4-01b0-46c2-b3b4-f9a0a5ca9e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.765752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47019ff4-01b0-46c2-b3b4-f9a0a5ca9e0a admin admin] PATH_INFO: `/v3/projects/47a3da4ca3724bbf844a2ec8c00bd551/users/c0b27d55f0a8415a9b60df5c77d9120d/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.771129 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 633/1263] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:51.774344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d1f5b-2af1-427e-b3ef-96a98fc44277 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.774344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d1f5b-2af1-427e-b3ef-96a98fc44277 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.774344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d1f5b-2af1-427e-b3ef-96a98fc44277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.788259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47019ff4-01b0-46c2-b3b4-f9a0a5ca9e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a3da4ca3724bbf844a2ec8c00bd551, user_id=c0b27d55f0a8415a9b60df5c77d9120d, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.791445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47019ff4-01b0-46c2-b3b4-f9a0a5ca9e0a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.802782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a32d1f5b-2af1-427e-b3ef-96a98fc44277 None None] MFA Rules not processed for user `a0ad98167dcd4eeea98b7e3d56112a22`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:51.804094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a32d1f5b-2af1-427e-b3ef-96a98fc44277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:51.808055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 631/1264] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:51 2022] PUT /identity/v3/projects/47a3da4ca3724bbf844a2ec8c00bd551/users/c0b27d55f0a8415a9b60df5c77d9120d/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:51.808827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47019ff4-01b0-46c2-b3b4-f9a0a5ca9e0a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.877926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47019ff4-01b0-46c2-b3b4-f9a0a5ca9e0a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.882850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794cb3-34c6-431f-b0a1-673a4251267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.883495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794cb3-34c6-431f-b0a1-673a4251267f admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.883777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794cb3-34c6-431f-b0a1-673a4251267f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.884051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794cb3-34c6-431f-b0a1-673a4251267f admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.884693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1794cb3-34c6-431f-b0a1-673a4251267f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.886613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1794cb3-34c6-431f-b0a1-673a4251267f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.896895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 634/1265] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:51.897744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d1f5b-2af1-427e-b3ef-96a98fc44277 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.912440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d1f5b-2af1-427e-b3ef-96a98fc44277 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.916825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 632/1266] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:51.916825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794cb3-34c6-431f-b0a1-673a4251267f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.921115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f5161-81ce-4dd0-ad12-15e016761852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.922336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f5161-81ce-4dd0-ad12-15e016761852 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.922616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f5161-81ce-4dd0-ad12-15e016761852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.922912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f5161-81ce-4dd0-ad12-15e016761852 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.923584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f5161-81ce-4dd0-ad12-15e016761852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.926176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f5161-81ce-4dd0-ad12-15e016761852 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.933251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794cb3-34c6-431f-b0a1-673a4251267f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.941616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138becc-cd3e-4a3f-bf0b-d9fbd2fd93e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.942360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138becc-cd3e-4a3f-bf0b-d9fbd2fd93e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.942779 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138becc-cd3e-4a3f-bf0b-d9fbd2fd93e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.943037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138becc-cd3e-4a3f-bf0b-d9fbd2fd93e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.943860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138becc-cd3e-4a3f-bf0b-d9fbd2fd93e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.945858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138becc-cd3e-4a3f-bf0b-d9fbd2fd93e4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.955113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 635/1267] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/users => generated 290 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:51.956641 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f5161-81ce-4dd0-ad12-15e016761852 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:51.968147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f5161-81ce-4dd0-ad12-15e016761852 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:51.979613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba381e6-31dd-459c-8c61-9edcbb994a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:51.980295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba381e6-31dd-459c-8c61-9edcbb994a3c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:51.980571 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba381e6-31dd-459c-8c61-9edcbb994a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:51.980846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba381e6-31dd-459c-8c61-9edcbb994a3c admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:51.981873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba381e6-31dd-459c-8c61-9edcbb994a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:51.984947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 633/1268] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/users => generated 286 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:51.986650 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba381e6-31dd-459c-8c61-9edcbb994a3c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:51.987874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138becc-cd3e-4a3f-bf0b-d9fbd2fd93e4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.000193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138becc-cd3e-4a3f-bf0b-d9fbd2fd93e4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.005867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b27d9-76ed-4fc6-9c95-ab443443622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.006490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b27d9-76ed-4fc6-9c95-ab443443622c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.006791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b27d9-76ed-4fc6-9c95-ab443443622c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.007053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b27d9-76ed-4fc6-9c95-ab443443622c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.007721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b27d9-76ed-4fc6-9c95-ab443443622c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.009416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b27d9-76ed-4fc6-9c95-ab443443622c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.022392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 636/1269] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:20:51 2022] POST /identity/v3/users => generated 287 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:52.024123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 634/1270] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:52.025115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b27d9-76ed-4fc6-9c95-ab443443622c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.027556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f18081-b130-4bce-9940-fc92caad0a82 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.027857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f18081-b130-4bce-9940-fc92caad0a82 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.028136 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f18081-b130-4bce-9940-fc92caad0a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.037118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b27d9-76ed-4fc6-9c95-ab443443622c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.042027 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f7dc3-7846-4c95-8527-cceb7e2b0b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.042988 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f7dc3-7846-4c95-8527-cceb7e2b0b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.043511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f7dc3-7846-4c95-8527-cceb7e2b0b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.044064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f7dc3-7846-4c95-8527-cceb7e2b0b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.044869 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f7dc3-7846-4c95-8527-cceb7e2b0b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.046957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f7dc3-7846-4c95-8527-cceb7e2b0b0e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.073292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-78f18081-b130-4bce-9940-fc92caad0a82 None None] MFA Rules not processed for user `c0b27d55f0a8415a9b60df5c77d9120d`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:52.074570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-78f18081-b130-4bce-9940-fc92caad0a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:52.086703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 635/1271] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:20:52 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:52.087653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f7dc3-7846-4c95-8527-cceb7e2b0b0e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.117468 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:52.124958 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:52.167653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 637/1272] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:52.168857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f18081-b130-4bce-9940-fc92caad0a82 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.177628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f7dc3-7846-4c95-8527-cceb7e2b0b0e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.182663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abea0c8-74d9-45c7-8265-5bc418fbc6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.183305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abea0c8-74d9-45c7-8265-5bc418fbc6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.183601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abea0c8-74d9-45c7-8265-5bc418fbc6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.183879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abea0c8-74d9-45c7-8265-5bc418fbc6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.184351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f18081-b130-4bce-9940-fc92caad0a82 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.184526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abea0c8-74d9-45c7-8265-5bc418fbc6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.186282 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abea0c8-74d9-45c7-8265-5bc418fbc6e4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.191415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f66b-eebc-43a0-9fe0-5eb794f59753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.192504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f66b-eebc-43a0-9fe0-5eb794f59753 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.192963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f66b-eebc-43a0-9fe0-5eb794f59753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.193602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f66b-eebc-43a0-9fe0-5eb794f59753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.194505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95f66b-eebc-43a0-9fe0-5eb794f59753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.196388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95f66b-eebc-43a0-9fe0-5eb794f59753 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.202044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 636/1273] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:52.202044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abea0c8-74d9-45c7-8265-5bc418fbc6e4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.213700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abea0c8-74d9-45c7-8265-5bc418fbc6e4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.215062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 638/1274] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:52.216410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f66b-eebc-43a0-9fe0-5eb794f59753 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.219253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01b569-e59b-43ae-841a-5c91590f1a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.220065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01b569-e59b-43ae-841a-5c91590f1a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.220354 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01b569-e59b-43ae-841a-5c91590f1a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.220632 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01b569-e59b-43ae-841a-5c91590f1a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.221377 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01b569-e59b-43ae-841a-5c91590f1a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.223199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01b569-e59b-43ae-841a-5c91590f1a0b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.229413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f66b-eebc-43a0-9fe0-5eb794f59753 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.235175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 637/1275] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:52.235943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8dd72-eb66-4034-9c37-c4a48ca8a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.236276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01b569-e59b-43ae-841a-5c91590f1a0b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.237410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8dd72-eb66-4034-9c37-c4a48ca8a621 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.237915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8dd72-eb66-4034-9c37-c4a48ca8a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.238738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8dd72-eb66-4034-9c37-c4a48ca8a621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.239706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8dd72-eb66-4034-9c37-c4a48ca8a621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.241923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8dd72-eb66-4034-9c37-c4a48ca8a621 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.248709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01b569-e59b-43ae-841a-5c91590f1a0b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.254521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d7ffb-7151-4a90-beb7-139631eed2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.255190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d7ffb-7151-4a90-beb7-139631eed2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.255524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d7ffb-7151-4a90-beb7-139631eed2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.255804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d7ffb-7151-4a90-beb7-139631eed2a1 admin admin] PATH_INFO: `/v3/projects/e28b2fee5e9043388c98a4f56d789f90/users/24211a806cfa4ee6b72c2e7b6074d473/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.258024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 639/1276] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:52.259330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8dd72-eb66-4034-9c37-c4a48ca8a621 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.271138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8dd72-eb66-4034-9c37-c4a48ca8a621 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.274739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d7ffb-7151-4a90-beb7-139631eed2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28b2fee5e9043388c98a4f56d789f90, user_id=24211a806cfa4ee6b72c2e7b6074d473, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.276988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b32246-7050-4c37-a185-5824878a5e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.277650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d7ffb-7151-4a90-beb7-139631eed2a1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.278024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b32246-7050-4c37-a185-5824878a5e2c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.278460 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b32246-7050-4c37-a185-5824878a5e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.278891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b32246-7050-4c37-a185-5824878a5e2c admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.280046 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b32246-7050-4c37-a185-5824878a5e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.282467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b32246-7050-4c37-a185-5824878a5e2c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.293695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 638/1277] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:52 2022] PUT /identity/v3/projects/e28b2fee5e9043388c98a4f56d789f90/users/24211a806cfa4ee6b72c2e7b6074d473/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:52.295443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d7ffb-7151-4a90-beb7-139631eed2a1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.316271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 640/1278] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:20:52 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:52.317219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b32246-7050-4c37-a185-5824878a5e2c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.328318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b32246-7050-4c37-a185-5824878a5e2c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.381570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d7ffb-7151-4a90-beb7-139631eed2a1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.387813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1153c0-1499-45d7-b461-3f5953c8ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.389321 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1153c0-1499-45d7-b461-3f5953c8ac80 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.389644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1153c0-1499-45d7-b461-3f5953c8ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.389925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1153c0-1499-45d7-b461-3f5953c8ac80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.390839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1153c0-1499-45d7-b461-3f5953c8ac80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.392948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1153c0-1499-45d7-b461-3f5953c8ac80 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.399621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b684c-ff3a-4ff1-a1bc-92ba4adfb209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.400551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b684c-ff3a-4ff1-a1bc-92ba4adfb209 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.401236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b684c-ff3a-4ff1-a1bc-92ba4adfb209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.401614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b684c-ff3a-4ff1-a1bc-92ba4adfb209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.402564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b684c-ff3a-4ff1-a1bc-92ba4adfb209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.404290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b684c-ff3a-4ff1-a1bc-92ba4adfb209 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.418855 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 641/1279] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:52.420375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b684c-ff3a-4ff1-a1bc-92ba4adfb209 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.432536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b684c-ff3a-4ff1-a1bc-92ba4adfb209 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.437241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 639/1280] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:20:52 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:52.438469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1153c0-1499-45d7-b461-3f5953c8ac80 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.441666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a37c1-5621-4d37-ae20-cb5c29b2aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.442645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a37c1-5621-4d37-ae20-cb5c29b2aea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.443152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a37c1-5621-4d37-ae20-cb5c29b2aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.443555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a37c1-5621-4d37-ae20-cb5c29b2aea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.444588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a37c1-5621-4d37-ae20-cb5c29b2aea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.447700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a37c1-5621-4d37-ae20-cb5c29b2aea0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.464909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 642/1281] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:52.465790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a37c1-5621-4d37-ae20-cb5c29b2aea0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.490204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a37c1-5621-4d37-ae20-cb5c29b2aea0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.543086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1153c0-1499-45d7-b461-3f5953c8ac80 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.549866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b0c34-a332-4117-a8c3-b1d7997ef960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.550506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b0c34-a332-4117-a8c3-b1d7997ef960 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.550792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b0c34-a332-4117-a8c3-b1d7997ef960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.551072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b0c34-a332-4117-a8c3-b1d7997ef960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.551787 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b0c34-a332-4117-a8c3-b1d7997ef960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.553420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b0c34-a332-4117-a8c3-b1d7997ef960 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.556055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:52.572292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 640/1282] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:52.572292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b2062-5bcf-434a-a29e-86cf91f75913 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.572292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b2062-5bcf-434a-a29e-86cf91f75913 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.572292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b2062-5bcf-434a-a29e-86cf91f75913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.589688 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b56c-2749-47bb-bf85-14c38ef8e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.590596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b56c-2749-47bb-bf85-14c38ef8e26e admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.590847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b56c-2749-47bb-bf85-14c38ef8e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.591223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b56c-2749-47bb-bf85-14c38ef8e26e admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.592250 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4b56c-2749-47bb-bf85-14c38ef8e26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.594242 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4b56c-2749-47bb-bf85-14c38ef8e26e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.605436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 643/1283] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:52.606491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b56c-2749-47bb-bf85-14c38ef8e26e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.611785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-803b2062-5bcf-434a-a29e-86cf91f75913 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:52.613417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-803b2062-5bcf-434a-a29e-86cf91f75913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:52.621489 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b56c-2749-47bb-bf85-14c38ef8e26e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.627380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 641/1284] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:52.628123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762996b7-afcb-4bca-ab76-e4edd7719360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.628957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b2062-5bcf-434a-a29e-86cf91f75913 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.629541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762996b7-afcb-4bca-ab76-e4edd7719360 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.630125 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762996b7-afcb-4bca-ab76-e4edd7719360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.630708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762996b7-afcb-4bca-ab76-e4edd7719360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.631551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762996b7-afcb-4bca-ab76-e4edd7719360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.633911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762996b7-afcb-4bca-ab76-e4edd7719360 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.642257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b2062-5bcf-434a-a29e-86cf91f75913 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.649951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944f17b-1979-4059-913f-0c4b826ebd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.651037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 644/1285] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:52.652207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762996b7-afcb-4bca-ab76-e4edd7719360 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.654098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f17b-1979-4059-913f-0c4b826ebd34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.654592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f17b-1979-4059-913f-0c4b826ebd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.654975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f17b-1979-4059-913f-0c4b826ebd34 admin admin] PATH_INFO: `/v3/projects/055d8bd0d84d472dabc4764c6e18c75e/users/198371c3483a4bf180fe2e12eb628893/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.666929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762996b7-afcb-4bca-ab76-e4edd7719360 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.672910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ef37-03a4-4a00-9bae-1bd5dfa5626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.673506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ef37-03a4-4a00-9bae-1bd5dfa5626c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.673788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ef37-03a4-4a00-9bae-1bd5dfa5626c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.673975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944f17b-1979-4059-913f-0c4b826ebd34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055d8bd0d84d472dabc4764c6e18c75e, user_id=198371c3483a4bf180fe2e12eb628893, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.674096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7ef37-03a4-4a00-9bae-1bd5dfa5626c admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.675640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7ef37-03a4-4a00-9bae-1bd5dfa5626c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.677284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944f17b-1979-4059-913f-0c4b826ebd34 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.678248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7ef37-03a4-4a00-9bae-1bd5dfa5626c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.692651 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:52.697038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 642/1286] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:52 2022] PUT /identity/v3/projects/055d8bd0d84d472dabc4764c6e18c75e/users/198371c3483a4bf180fe2e12eb628893/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:52.698039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944f17b-1979-4059-913f-0c4b826ebd34 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.713320 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 645/1287] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:20:52 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:20:52.714440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ef37-03a4-4a00-9bae-1bd5dfa5626c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.726109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7ef37-03a4-4a00-9bae-1bd5dfa5626c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.798689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944f17b-1979-4059-913f-0c4b826ebd34 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.805957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d31a-ead5-4f71-8401-62be89353226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.806641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d31a-ead5-4f71-8401-62be89353226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.806929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d31a-ead5-4f71-8401-62be89353226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.807207 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d31a-ead5-4f71-8401-62be89353226 admin admin] PATH_INFO: `/v3/projects/46f796f815ab436c863d44df2d1ea317/users/d48b8eb7ac8f43fb92c153ec61b990d7/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.830222 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5d31a-ead5-4f71-8401-62be89353226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f796f815ab436c863d44df2d1ea317, user_id=d48b8eb7ac8f43fb92c153ec61b990d7, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.833362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5d31a-ead5-4f71-8401-62be89353226 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.844808 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2e8e8-b0a9-40d2-a437-a66f161fc660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.845902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2e8e8-b0a9-40d2-a437-a66f161fc660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.846749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2e8e8-b0a9-40d2-a437-a66f161fc660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.847047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2e8e8-b0a9-40d2-a437-a66f161fc660 admin admin] PATH_INFO: `/v3/projects/16af1ebbeb9d4ff8809f9e26a34c65bd/users/d57201444ed64feabff3dceabc73e261/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:52.851638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 643/1288] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:52 2022] PUT /identity/v3/projects/46f796f815ab436c863d44df2d1ea317/users/d48b8eb7ac8f43fb92c153ec61b990d7/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:52.854125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d31a-ead5-4f71-8401-62be89353226 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.866093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2e8e8-b0a9-40d2-a437-a66f161fc660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16af1ebbeb9d4ff8809f9e26a34c65bd, user_id=d57201444ed64feabff3dceabc73e261, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:52.868957 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2e8e8-b0a9-40d2-a437-a66f161fc660 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:52.894919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 646/1289] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:52 2022] PUT /identity/v3/projects/16af1ebbeb9d4ff8809f9e26a34c65bd/users/d57201444ed64feabff3dceabc73e261/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:52.894919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2e8e8-b0a9-40d2-a437-a66f161fc660 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:52.932857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d31a-ead5-4f71-8401-62be89353226 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.950357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2e8e8-b0a9-40d2-a437-a66f161fc660 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:52.957457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8bfc2-fdd5-4fda-aede-55d1e76597e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:52.958170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8bfc2-fdd5-4fda-aede-55d1e76597e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:52.958790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8bfc2-fdd5-4fda-aede-55d1e76597e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:52.958790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8bfc2-fdd5-4fda-aede-55d1e76597e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.005886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:53.023474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5873c3-db3c-4854-a80f-10fb3eee7ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:53.024390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5873c3-db3c-4854-a80f-10fb3eee7ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.024673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5873c3-db3c-4854-a80f-10fb3eee7ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.025313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5873c3-db3c-4854-a80f-10fb3eee7ad9 admin admin] PATH_INFO: `/v3/projects/da8c4f1dbaf945fa914c11ff8f00b787/users/f960628119664bafa51349a18ba741b8/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.107574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8bfc2-fdd5-4fda-aede-55d1e76597e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:53.108803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5873c3-db3c-4854-a80f-10fb3eee7ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8c4f1dbaf945fa914c11ff8f00b787, user_id=f960628119664bafa51349a18ba741b8, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:53.108803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5873c3-db3c-4854-a80f-10fb3eee7ad9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:53.109062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8bfc2-fdd5-4fda-aede-55d1e76597e2 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:53.109156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 644/1290] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:52 2022] PUT /identity/v3/projects/da8c4f1dbaf945fa914c11ff8f00b787/users/f960628119664bafa51349a18ba741b8/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:53.109156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5873c3-db3c-4854-a80f-10fb3eee7ad9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:53.109305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 647/1291] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:53.109305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abcada-402a-45d8-89ab-750a2972fb98 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.109305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abcada-402a-45d8-89ab-750a2972fb98 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.109305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abcada-402a-45d8-89ab-750a2972fb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.159623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b1abcada-402a-45d8-89ab-750a2972fb98 None None] MFA Rules not processed for user `198371c3483a4bf180fe2e12eb628893`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:53.161021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b1abcada-402a-45d8-89ab-750a2972fb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:53.174750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:53.203860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5873c3-db3c-4854-a80f-10fb3eee7ad9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:53.215907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8278152-f6ad-402c-a625-636c5a8b9eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:53.216735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8278152-f6ad-402c-a625-636c5a8b9eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.217038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8278152-f6ad-402c-a625-636c5a8b9eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.217381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8278152-f6ad-402c-a625-636c5a8b9eb1 admin admin] PATH_INFO: `/v3/projects/87eebb2d33fd469db4484045024561eb/users/6698f2d44cd8463bbad39b400e8c94ce/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.240335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8278152-f6ad-402c-a625-636c5a8b9eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87eebb2d33fd469db4484045024561eb, user_id=6698f2d44cd8463bbad39b400e8c94ce, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:53.244466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8278152-f6ad-402c-a625-636c5a8b9eb1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:53.248894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 648/1292] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:53.249785 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abcada-402a-45d8-89ab-750a2972fb98 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:53.269995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abcada-402a-45d8-89ab-750a2972fb98 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:53.276861 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 645/1293] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:53 2022] PUT /identity/v3/projects/87eebb2d33fd469db4484045024561eb/users/6698f2d44cd8463bbad39b400e8c94ce/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:53.282836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e07de-7c3b-4162-8e08-afcc653cf2de None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.282836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e07de-7c3b-4162-8e08-afcc653cf2de None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.283156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e07de-7c3b-4162-8e08-afcc653cf2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.310325 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-693e07de-7c3b-4162-8e08-afcc653cf2de None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:53.312053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-693e07de-7c3b-4162-8e08-afcc653cf2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:53.367454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d06c8-5671-4ffa-91d0-1360ec5d6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:53.368144 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d06c8-5671-4ffa-91d0-1360ec5d6a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.370955 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d06c8-5671-4ffa-91d0-1360ec5d6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.371261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d06c8-5671-4ffa-91d0-1360ec5d6a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.371960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d06c8-5671-4ffa-91d0-1360ec5d6a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:53.373597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d06c8-5671-4ffa-91d0-1360ec5d6a36 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:53.393568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 646/1294] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:53.395468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 649/1295] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:53.397498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63476a6-27d2-4b16-bf1f-683a14b1985e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.397878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63476a6-27d2-4b16-bf1f-683a14b1985e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.398141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63476a6-27d2-4b16-bf1f-683a14b1985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.401490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fea11-dab7-4c94-a295-3b47252710da None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.401776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fea11-dab7-4c94-a295-3b47252710da None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.402107 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fea11-dab7-4c94-a295-3b47252710da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.437862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-185fea11-dab7-4c94-a295-3b47252710da None None] MFA Rules not processed for user `d57201444ed64feabff3dceabc73e261`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:53.438782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-185fea11-dab7-4c94-a295-3b47252710da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:53.451300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f63476a6-27d2-4b16-bf1f-683a14b1985e None None] MFA Rules not processed for user `f960628119664bafa51349a18ba741b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:53.452667 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f63476a6-27d2-4b16-bf1f-683a14b1985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:53.527733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:53.544431 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 647/1296] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:53.545492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fea11-dab7-4c94-a295-3b47252710da None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:53.556132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 650/1297] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:53.557272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63476a6-27d2-4b16-bf1f-683a14b1985e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:53.592088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63476a6-27d2-4b16-bf1f-683a14b1985e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:53.614563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7cf86-9cc0-4a07-837f-4f49cb31d3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:53.615204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7cf86-9cc0-4a07-837f-4f49cb31d3be admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.615516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7cf86-9cc0-4a07-837f-4f49cb31d3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.615795 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7cf86-9cc0-4a07-837f-4f49cb31d3be admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.616449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7cf86-9cc0-4a07-837f-4f49cb31d3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:53.618178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7cf86-9cc0-4a07-837f-4f49cb31d3be admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:53.649456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 651/1298] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:53.650146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7cf86-9cc0-4a07-837f-4f49cb31d3be admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:53.680581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7cf86-9cc0-4a07-837f-4f49cb31d3be admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:53.699316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be08c0e-9829-4d50-81ab-1f740d4859a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:53.700021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be08c0e-9829-4d50-81ab-1f740d4859a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.700306 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be08c0e-9829-4d50-81ab-1f740d4859a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.700842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be08c0e-9829-4d50-81ab-1f740d4859a9 admin admin] PATH_INFO: `/v3/projects/23599590348a479089571a407dcb7527/users/19186fb597ec4922a8953c73c3b0c8e7/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.735335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be08c0e-9829-4d50-81ab-1f740d4859a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23599590348a479089571a407dcb7527, user_id=19186fb597ec4922a8953c73c3b0c8e7, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:53.740070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be08c0e-9829-4d50-81ab-1f740d4859a9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:53.754716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fea11-dab7-4c94-a295-3b47252710da None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:53.759917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b6138-00ad-44d2-87f6-2c8533fb4da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:53.760634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6138-00ad-44d2-87f6-2c8533fb4da5 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.760923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6138-00ad-44d2-87f6-2c8533fb4da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.761203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6138-00ad-44d2-87f6-2c8533fb4da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.779500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 652/1299] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:53 2022] PUT /identity/v3/projects/23599590348a479089571a407dcb7527/users/19186fb597ec4922a8953c73c3b0c8e7/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:53.784424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be08c0e-9829-4d50-81ab-1f740d4859a9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:53.790025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:53.863680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be08c0e-9829-4d50-81ab-1f740d4859a9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:53.869153 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4989-478e-4b33-86ea-0b004351a9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:53.869776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4989-478e-4b33-86ea-0b004351a9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.870102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4989-478e-4b33-86ea-0b004351a9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.870512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4989-478e-4b33-86ea-0b004351a9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.879783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b6138-00ad-44d2-87f6-2c8533fb4da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:53.882122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b6138-00ad-44d2-87f6-2c8533fb4da5 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:53.893083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 648/1300] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:53.895555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df02e2-1d58-48c5-8492-709fe48916bd None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.896171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df02e2-1d58-48c5-8492-709fe48916bd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.896636 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df02e2-1d58-48c5-8492-709fe48916bd None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.898404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 649/1301] 10.222.0.23 () {54 vars in 961 bytes} [Fri Oct 21 21:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:20:53.899732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42299a-3f28-4e48-9839-6fa124159249 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:53.900170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42299a-3f28-4e48-9839-6fa124159249 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:53.900592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42299a-3f28-4e48-9839-6fa124159249 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:53.912358 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 650/1302] 10.222.0.23 () {54 vars in 961 bytes} [Fri Oct 21 21:20:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:20:53.913856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42299a-3f28-4e48-9839-6fa124159249 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:53.998480 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd4989-478e-4b33-86ea-0b004351a9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:54.001030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd4989-478e-4b33-86ea-0b004351a9b7 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:54.013675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 653/1303] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:54.014772 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4989-478e-4b33-86ea-0b004351a9b7 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:54.017398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42299a-3f28-4e48-9839-6fa124159249 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:54.023249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7849db9-10e0-437c-9935-d7fa64f8b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:54.024465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7849db9-10e0-437c-9935-d7fa64f8b439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:54.024852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7849db9-10e0-437c-9935-d7fa64f8b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:54.025230 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7849db9-10e0-437c-9935-d7fa64f8b439 admin admin] PATH_INFO: `/v3/projects/87eebb2d33fd469db4484045024561eb/users/6698f2d44cd8463bbad39b400e8c94ce/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:54.026904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4989-478e-4b33-86ea-0b004351a9b7 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:54.027705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7849db9-10e0-437c-9935-d7fa64f8b439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87eebb2d33fd469db4484045024561eb, user_id=6698f2d44cd8463bbad39b400e8c94ce, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:54.030771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7849db9-10e0-437c-9935-d7fa64f8b439 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:54.032816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735fdb-bafb-4b81-b4a7-d579adafa4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:54.033622 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735fdb-bafb-4b81-b4a7-d579adafa4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:54.034594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735fdb-bafb-4b81-b4a7-d579adafa4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:54.035030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735fdb-bafb-4b81-b4a7-d579adafa4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:54.035880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735fdb-bafb-4b81-b4a7-d579adafa4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:54.038006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735fdb-bafb-4b81-b4a7-d579adafa4e5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:54.048499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 651/1304] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:53 2022] PUT /identity/v3/projects/87eebb2d33fd469db4484045024561eb/users/6698f2d44cd8463bbad39b400e8c94ce/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:54.051320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038fe47-38f1-4256-8324-4beab0f90823 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:54.053790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038fe47-38f1-4256-8324-4beab0f90823 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:54.054231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038fe47-38f1-4256-8324-4beab0f90823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:54.068056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 654/1305] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:20:54.069917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550a82-8b27-4fc9-bdc3-2af4ab94097d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:54.070304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550a82-8b27-4fc9-bdc3-2af4ab94097d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:54.070684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550a82-8b27-4fc9-bdc3-2af4ab94097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:54.131532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5c550a82-8b27-4fc9-bdc3-2af4ab94097d None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:54.135510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5c550a82-8b27-4fc9-bdc3-2af4ab94097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:54.153549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2038fe47-38f1-4256-8324-4beab0f90823 None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:54.156256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2038fe47-38f1-4256-8324-4beab0f90823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:54.220553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:54.349533 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 652/1306] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Oct 21 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:54.351065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfee31-e9f3-492b-906b-391187d576f0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:54.351498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfee31-e9f3-492b-906b-391187d576f0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:54.351867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfee31-e9f3-492b-906b-391187d576f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:54.361451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 655/1307] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Oct 21 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:54.362467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c550a82-8b27-4fc9-bdc3-2af4ab94097d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:54.400768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8adfee31-e9f3-492b-906b-391187d576f0 None None] MFA Rules not processed for user `6698f2d44cd8463bbad39b400e8c94ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:54.402302 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8adfee31-e9f3-492b-906b-391187d576f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:54.407752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:54.522576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c550a82-8b27-4fc9-bdc3-2af4ab94097d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:54.536285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d979-c384-4da5-8af6-309567154b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:54.540053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d979-c384-4da5-8af6-309567154b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:54.540342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d979-c384-4da5-8af6-309567154b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:54.540804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d979-c384-4da5-8af6-309567154b24 admin admin] PATH_INFO: `/v3/projects/23599590348a479089571a407dcb7527/users/19186fb597ec4922a8953c73c3b0c8e7/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:54.552313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876d979-c384-4da5-8af6-309567154b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23599590348a479089571a407dcb7527, user_id=19186fb597ec4922a8953c73c3b0c8e7, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:54.564262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876d979-c384-4da5-8af6-309567154b24 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:54.599499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 656/1308] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:20:54 2022] PUT /identity/v3/projects/23599590348a479089571a407dcb7527/users/19186fb597ec4922a8953c73c3b0c8e7/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:54.600903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d979-c384-4da5-8af6-309567154b24 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:54.604726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 653/1309] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:54.605662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfee31-e9f3-492b-906b-391187d576f0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:54.645362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfee31-e9f3-492b-906b-391187d576f0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:54.790722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d979-c384-4da5-8af6-309567154b24 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:54.806048 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7050-3a59-493f-b185-c6304f56e80e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:54.806936 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7050-3a59-493f-b185-c6304f56e80e service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:54.807221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7050-3a59-493f-b185-c6304f56e80e service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:54.807541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7050-3a59-493f-b185-c6304f56e80e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:54.831067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a770878-edbe-4cd5-a739-d3c2798e8c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:54.832237 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a770878-edbe-4cd5-a739-d3c2798e8c4a service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:54.832525 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a770878-edbe-4cd5-a739-d3c2798e8c4a service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:54.832947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a770878-edbe-4cd5-a739-d3c2798e8c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:54.939045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:54.967399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7050-3a59-493f-b185-c6304f56e80e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:54.972439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7050-3a59-493f-b185-c6304f56e80e service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:54.975189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a770878-edbe-4cd5-a739-d3c2798e8c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:54.979001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a770878-edbe-4cd5-a739-d3c2798e8c4a service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:54.998438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 657/1310] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:55.000729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe02fb-8a51-4b80-a52c-cfa7248474af None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:55.001315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe02fb-8a51-4b80-a52c-cfa7248474af None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:55.002358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe02fb-8a51-4b80-a52c-cfa7248474af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:55.003958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 654/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:55.005973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a770878-edbe-4cd5-a739-d3c2798e8c4a service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:55.111393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-dffe02fb-8a51-4b80-a52c-cfa7248474af None None] MFA Rules not processed for user `19186fb597ec4922a8953c73c3b0c8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:55.115596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dffe02fb-8a51-4b80-a52c-cfa7248474af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:55.128740 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a770878-edbe-4cd5-a739-d3c2798e8c4a service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:55.136878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a84f9f-1d10-46b7-8a13-bdde7e440765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:55.138887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a84f9f-1d10-46b7-8a13-bdde7e440765 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:55.139330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a84f9f-1d10-46b7-8a13-bdde7e440765 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:55.140412 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a84f9f-1d10-46b7-8a13-bdde7e440765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:55.249097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:55.319900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 658/1312] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:55.321016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a84f9f-1d10-46b7-8a13-bdde7e440765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:55.323981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a84f9f-1d10-46b7-8a13-bdde7e440765 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:55.347260 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 655/1313] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:55.425503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe02fb-8a51-4b80-a52c-cfa7248474af None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:55.440522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe02fb-8a51-4b80-a52c-cfa7248474af None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:55.461592 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a8230-a936-480b-8c3b-f97ff2b88e4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:55.463842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a8230-a936-480b-8c3b-f97ff2b88e4c service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:55.464570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a8230-a936-480b-8c3b-f97ff2b88e4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:55.466111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a8230-a936-480b-8c3b-f97ff2b88e4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:55.492409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a8230-a936-480b-8c3b-f97ff2b88e4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:55.494008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a8230-a936-480b-8c3b-f97ff2b88e4c service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:55.533469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 659/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:55.689524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861831cf-07b5-42e2-8aa7-e4e537ac56ed None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:55.689524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861831cf-07b5-42e2-8aa7-e4e537ac56ed None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:55.689524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861831cf-07b5-42e2-8aa7-e4e537ac56ed None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:55.689524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 656/1315] 10.222.0.23 () {54 vars in 912 bytes} [Fri Oct 21 21:20:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:20:55.704079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb45337-fd34-4aac-b63e-eddee2794164 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:55.704079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb45337-fd34-4aac-b63e-eddee2794164 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:55.704079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb45337-fd34-4aac-b63e-eddee2794164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:55.774811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8e76-6c52-4ad0-87ec-156498af2448 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:55.775160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8e76-6c52-4ad0-87ec-156498af2448 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:55.775503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8e76-6c52-4ad0-87ec-156498af2448 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:55.777885 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 657/1316] 10.222.0.23 () {54 vars in 912 bytes} [Fri Oct 21 21:20:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:20:55.782283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6cb45337-fd34-4aac-b63e-eddee2794164 None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:55.783578 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6cb45337-fd34-4aac-b63e-eddee2794164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:55.786220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a38209-840a-411f-a420-1368275ad80c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:55.786514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a38209-840a-411f-a420-1368275ad80c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:55.786792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a38209-840a-411f-a420-1368275ad80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:55.811849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e6a38209-840a-411f-a420-1368275ad80c None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:55.811989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 660/1317] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:20:55.813410 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e6a38209-840a-411f-a420-1368275ad80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:55.835637 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 658/1318] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:20:55.863617 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb45337-fd34-4aac-b63e-eddee2794164 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:55.872506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a38209-840a-411f-a420-1368275ad80c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:55.876505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb45337-fd34-4aac-b63e-eddee2794164 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:55.886193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a38209-840a-411f-a420-1368275ad80c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:55.889692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cf3e4-a559-47f2-90d3-271bb59e92d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:55.890670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf3e4-a559-47f2-90d3-271bb59e92d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:55.891162 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf3e4-a559-47f2-90d3-271bb59e92d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:55.891666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cf3e4-a559-47f2-90d3-271bb59e92d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:55.894906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05d9b7-ea8e-4e1a-aa16-b7782baca355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:55.895816 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d9b7-ea8e-4e1a-aa16-b7782baca355 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:55.896103 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d9b7-ea8e-4e1a-aa16-b7782baca355 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:55.896378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d9b7-ea8e-4e1a-aa16-b7782baca355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:55.907441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cf3e4-a559-47f2-90d3-271bb59e92d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:55.912630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cf3e4-a559-47f2-90d3-271bb59e92d3 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:55.920241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05d9b7-ea8e-4e1a-aa16-b7782baca355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:55.923160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05d9b7-ea8e-4e1a-aa16-b7782baca355 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:55.951308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 661/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:55.952843 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 659/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:20:56.518804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cf3e4-a559-47f2-90d3-271bb59e92d3 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:56.740549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cf3e4-a559-47f2-90d3-271bb59e92d3 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:56.755929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:56.756584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:56.756924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:56.757105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] PATH_INFO: `/v3/users/f960628119664bafa51349a18ba741b8` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:56.760208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f960628119664bafa51349a18ba741b8)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:56.774576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:56.886374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f960628119664bafa51349a18ba741b8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:56.888682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f960628119664bafa51349a18ba741b8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:56.911470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f960628119664bafa51349a18ba741b8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:56.925309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f960628119664bafa51349a18ba741b8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:56.926108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f960628119664bafa51349a18ba741b8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:56.973589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 662/1321] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:20:56 2022] DELETE /identity/v3/users/f960628119664bafa51349a18ba741b8 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:56.977926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866556ae-7444-4f35-ad89-6d12e7928d62 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:56.978443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866556ae-7444-4f35-ad89-6d12e7928d62 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:56.978443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866556ae-7444-4f35-ad89-6d12e7928d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:57.014028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-866556ae-7444-4f35-ad89-6d12e7928d62 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:57.020072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-866556ae-7444-4f35-ad89-6d12e7928d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:57.155627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 660/1322] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:57.239640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:57.241112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:57.339987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:57.475528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64466bd1-1e02-4eba-9835-14428943b65e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:57.497550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8b6aa-a384-4155-9214-2f96930fbf0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:57.504111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b6aa-a384-4155-9214-2f96930fbf0c service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:57.504514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b6aa-a384-4155-9214-2f96930fbf0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:57.504798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b6aa-a384-4155-9214-2f96930fbf0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:57.535318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8b6aa-a384-4155-9214-2f96930fbf0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:57.538951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8b6aa-a384-4155-9214-2f96930fbf0c service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:57.591715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 663/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:57.773441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866556ae-7444-4f35-ad89-6d12e7928d62 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:57.774921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-866556ae-7444-4f35-ad89-6d12e7928d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:57.812278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866556ae-7444-4f35-ad89-6d12e7928d62 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:57.830336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:57.835480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:57.835925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:57.836244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] PATH_INFO: `/v3/users/a0ad98167dcd4eeea98b7e3d56112a22` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:57.841730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ad98167dcd4eeea98b7e3d56112a22)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:57.842986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:20:57.842986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 21 21:20:57.842986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: Oct 21 21:20:57.845742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:57.858637 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:57.884303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8b6aa-a384-4155-9214-2f96930fbf0c service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:57.886092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-abe8b6aa-a384-4155-9214-2f96930fbf0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:57.918177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8b6aa-a384-4155-9214-2f96930fbf0c service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:57.925133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:57.926092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:57.926762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:57.927241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] PATH_INFO: `/v3/users/c0b27d55f0a8415a9b60df5c77d9120d` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:57.928764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b27d55f0a8415a9b60df5c77d9120d)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:57.932312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:58.091573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b27d55f0a8415a9b60df5c77d9120d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:58.092569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ad98167dcd4eeea98b7e3d56112a22'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:58.093061 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b27d55f0a8415a9b60df5c77d9120d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:58.105345 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b27d55f0a8415a9b60df5c77d9120d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:58.133171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b27d55f0a8415a9b60df5c77d9120d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:58.134317 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00512487-108a-46d3-a746-15b203eb9e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b27d55f0a8415a9b60df5c77d9120d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:58.144709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ad98167dcd4eeea98b7e3d56112a22'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:58.176229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 664/1324] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:20:57 2022] DELETE /identity/v3/users/c0b27d55f0a8415a9b60df5c77d9120d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:58.176229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e1811-588c-4a9b-b78c-5660c60d3fa9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:58.176229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e1811-588c-4a9b-b78c-5660c60d3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:58.176229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e1811-588c-4a9b-b78c-5660c60d3fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:58.184424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ad98167dcd4eeea98b7e3d56112a22'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:58.207710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ae9e1811-588c-4a9b-b78c-5660c60d3fa9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:58.209392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ae9e1811-588c-4a9b-b78c-5660c60d3fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:58.228121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ad98167dcd4eeea98b7e3d56112a22'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:58.228896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-83e51b7e-95ed-451f-b1f8-efefbfd3f961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ad98167dcd4eeea98b7e3d56112a22'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:58.240670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 661/1325] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:20:57 2022] DELETE /identity/v3/users/a0ad98167dcd4eeea98b7e3d56112a22 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:58.245416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b17bcb-614d-4aac-bdd6-29e9d9cc42b5 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:58.245702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b17bcb-614d-4aac-bdd6-29e9d9cc42b5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:58.245989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b17bcb-614d-4aac-bdd6-29e9d9cc42b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:58.298433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-66b17bcb-614d-4aac-bdd6-29e9d9cc42b5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:58.300223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-66b17bcb-614d-4aac-bdd6-29e9d9cc42b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:58.306381 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 665/1326] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:20:58.324920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e1811-588c-4a9b-b78c-5660c60d3fa9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:58.327171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ae9e1811-588c-4a9b-b78c-5660c60d3fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:58.389243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:20:58.428607 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e1811-588c-4a9b-b78c-5660c60d3fa9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:58.471115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 662/1327] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:20:58.472538 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b17bcb-614d-4aac-bdd6-29e9d9cc42b5 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:58.530147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537475d8-3906-4903-bc70-a426cc9be29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:58.531431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537475d8-3906-4903-bc70-a426cc9be29f service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:58.531706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537475d8-3906-4903-bc70-a426cc9be29f service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:58.532047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537475d8-3906-4903-bc70-a426cc9be29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:58.548584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537475d8-3906-4903-bc70-a426cc9be29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:58.552463 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537475d8-3906-4903-bc70-a426cc9be29f service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:58.569377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 666/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:58.612893 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b17bcb-614d-4aac-bdd6-29e9d9cc42b5 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:58.635567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024bfd6-f309-4aa3-9bd0-b75b6697cacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:58.636937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024bfd6-f309-4aa3-9bd0-b75b6697cacd service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:58.637222 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024bfd6-f309-4aa3-9bd0-b75b6697cacd service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:58.637534 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024bfd6-f309-4aa3-9bd0-b75b6697cacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:58.653734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024bfd6-f309-4aa3-9bd0-b75b6697cacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:58.655453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024bfd6-f309-4aa3-9bd0-b75b6697cacd service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:58.669567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 663/1329] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:20:59.522866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537475d8-3906-4903-bc70-a426cc9be29f service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:59.522866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-537475d8-3906-4903-bc70-a426cc9be29f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:59.555134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537475d8-3906-4903-bc70-a426cc9be29f service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:20:59.570816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:20:59.571841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:59.572333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:59.573685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] PATH_INFO: `/v3/users/d57201444ed64feabff3dceabc73e261` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:59.577751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57201444ed64feabff3dceabc73e261)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:20:59.588393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:20:59.734121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57201444ed64feabff3dceabc73e261'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:59.745235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57201444ed64feabff3dceabc73e261'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:59.777200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57201444ed64feabff3dceabc73e261'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:59.792255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57201444ed64feabff3dceabc73e261'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:59.793383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57201444ed64feabff3dceabc73e261'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:20:59.834243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 667/1330] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:20:59 2022] DELETE /identity/v3/users/d57201444ed64feabff3dceabc73e261 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:20:59.835732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cf1a8-0d57-4b28-9e1d-466970ffd11a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:20:59.836739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cf1a8-0d57-4b28-9e1d-466970ffd11a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:20:59.837194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cf1a8-0d57-4b28-9e1d-466970ffd11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:20:59.881271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:20:59.882296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4a8cf1a8-0d57-4b28-9e1d-466970ffd11a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:20:59.882907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:59.885584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4a8cf1a8-0d57-4b28-9e1d-466970ffd11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:20:59.984033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:00.077014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2a274-9b4d-4175-aaea-ebf5093ab5d7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:00.091520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:00.091520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:00.091520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:00.091520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] PATH_INFO: `/v3/projects/da8c4f1dbaf945fa914c11ff8f00b787` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:00.092370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8c4f1dbaf945fa914c11ff8f00b787)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:00.092573 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 664/1331] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:00.092672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 21 21:21:00.092672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 21 21:21:00.092672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: Oct 21 21:21:00.092672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:00.110136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cf1a8-0d57-4b28-9e1d-466970ffd11a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:00.111752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4a8cf1a8-0d57-4b28-9e1d-466970ffd11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:00.119935 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:00.266343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8c4f1dbaf945fa914c11ff8f00b787', 'request_id': 'req-75aaa5e6-0038-4e48-9348-0c661ac33cec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:00.280272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8c4f1dbaf945fa914c11ff8f00b787', 'request_id': 'req-75aaa5e6-0038-4e48-9348-0c661ac33cec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:00.288648 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cf1a8-0d57-4b28-9e1d-466970ffd11a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:00.311455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8c4f1dbaf945fa914c11ff8f00b787', 'request_id': 'req-75aaa5e6-0038-4e48-9348-0c661ac33cec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:00.341280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] The token cache is being invalidate because project da8c4f1dbaf945fa914c11ff8f00b787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:00.342228 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:00.343902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:00.346995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 668/1332] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:20:59 2022] DELETE /identity/v3/projects/da8c4f1dbaf945fa914c11ff8f00b787 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:00.352449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:00.355627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:00.434013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee190f-7837-4458-a1cd-c331412b6b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:00.434664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee190f-7837-4458-a1cd-c331412b6b4b service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:00.434946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee190f-7837-4458-a1cd-c331412b6b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:00.435222 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee190f-7837-4458-a1cd-c331412b6b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:00.437222 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-beee190f-7837-4458-a1cd-c331412b6b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:00.609300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaa5e6-0038-4e48-9348-0c661ac33cec admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:00.620882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee190f-7837-4458-a1cd-c331412b6b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:00.622370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee190f-7837-4458-a1cd-c331412b6b4b service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:00.631829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:00.632466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:00.632747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:00.633637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] PATH_INFO: `/v3/projects/47a3da4ca3724bbf844a2ec8c00bd551` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:00.635766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a3da4ca3724bbf844a2ec8c00bd551)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:00.637712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:00.652741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 665/1333] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:00.654097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cdc89-4cfd-44b9-adfd-01c13f189c57 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:00.654386 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cdc89-4cfd-44b9-adfd-01c13f189c57 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:00.654661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cdc89-4cfd-44b9-adfd-01c13f189c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:00.730456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ac0cdc89-4cfd-44b9-adfd-01c13f189c57 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:00.732280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ac0cdc89-4cfd-44b9-adfd-01c13f189c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:00.756768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 666/1334] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:00.764854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0588-c810-4038-b96e-b9bf21ecd1a8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:00.765117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0588-c810-4038-b96e-b9bf21ecd1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:00.765397 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0588-c810-4038-b96e-b9bf21ecd1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:00.801080 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a3da4ca3724bbf844a2ec8c00bd551', 'request_id': 'req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:00.820923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a3da4ca3724bbf844a2ec8c00bd551', 'request_id': 'req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:00.838101 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-85ed0588-c810-4038-b96e-b9bf21ecd1a8 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:00.839395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-85ed0588-c810-4038-b96e-b9bf21ecd1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:00.848746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a3da4ca3724bbf844a2ec8c00bd551', 'request_id': 'req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:00.878936 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] The token cache is being invalidate because project 47a3da4ca3724bbf844a2ec8c00bd551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:00.879169 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:00.881164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f8a89d5f-e59e-4fa1-9aaf-2715cf4b9d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:00.887671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 669/1335] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:00 2022] DELETE /identity/v3/projects/47a3da4ca3724bbf844a2ec8c00bd551 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:00.888985 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc02c-d6c3-42a7-904e-0889c33a682d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:00.891466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc02c-d6c3-42a7-904e-0889c33a682d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:00.891871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc02c-d6c3-42a7-904e-0889c33a682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:00.913377 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:00.985469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c53fc02c-d6c3-42a7-904e-0889c33a682d None None] MFA Rules not processed for user `84af08afd232473b8c1c83ac3f0dee3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:00.987577 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c53fc02c-d6c3-42a7-904e-0889c33a682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:01.004107 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 667/1336] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:01.005098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0588-c810-4038-b96e-b9bf21ecd1a8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:01.006468 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-85ed0588-c810-4038-b96e-b9bf21ecd1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:01.039053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0588-c810-4038-b96e-b9bf21ecd1a8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:01.045018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:01.063294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:01.063959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:01.064253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:01.064513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] PATH_INFO: `/v3/users/19186fb597ec4922a8953c73c3b0c8e7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:01.066988 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=19186fb597ec4922a8953c73c3b0c8e7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:01.068889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:01.177863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19186fb597ec4922a8953c73c3b0c8e7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:01.191179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19186fb597ec4922a8953c73c3b0c8e7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:01.193035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 670/1337] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:01.194446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fc02c-d6c3-42a7-904e-0889c33a682d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:01.204306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19186fb597ec4922a8953c73c3b0c8e7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:01.222805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fc02c-d6c3-42a7-904e-0889c33a682d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:01.232400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683db10-095e-4817-b7b7-375a4f813c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:01.232967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683db10-095e-4817-b7b7-375a4f813c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:01.233247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683db10-095e-4817-b7b7-375a4f813c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:01.233530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683db10-095e-4817-b7b7-375a4f813c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:01.234192 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683db10-095e-4817-b7b7-375a4f813c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:01.244484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683db10-095e-4817-b7b7-375a4f813c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:01.244484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683db10-095e-4817-b7b7-375a4f813c44 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:01.245335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19186fb597ec4922a8953c73c3b0c8e7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:01.246455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19186fb597ec4922a8953c73c3b0c8e7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:01.270643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 668/1338] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:01 2022] DELETE /identity/v3/users/19186fb597ec4922a8953c73c3b0c8e7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:01.274123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:01.277322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:01.284109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 671/1339] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:01.287960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62384a-b206-41c5-b4bb-635ee730af77 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:01.288165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62384a-b206-41c5-b4bb-635ee730af77 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:01.288399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62384a-b206-41c5-b4bb-635ee730af77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:01.328654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8b62384a-b206-41c5-b4bb-635ee730af77 None None] MFA Rules not processed for user `84af08afd232473b8c1c83ac3f0dee3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:01.335121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8b62384a-b206-41c5-b4bb-635ee730af77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:01.450898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31145d78-e258-40fb-ab3c-7ebe1228ae6d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:01.501828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:01.503661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:01.505492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:01.505783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] PATH_INFO: `/v3/projects/669d00fd24cd4a8e85b08e0758ab6f4c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:01.521168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669d00fd24cd4a8e85b08e0758ab6f4c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:01.525958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:01.554200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 672/1340] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:01.559749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62384a-b206-41c5-b4bb-635ee730af77 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:01.561338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8b62384a-b206-41c5-b4bb-635ee730af77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:01.591047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62384a-b206-41c5-b4bb-635ee730af77 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:01.607247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee4e3e-54e6-47f3-b74a-5afeb2158c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:01.608311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4e3e-54e6-47f3-b74a-5afeb2158c34 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:01.608743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4e3e-54e6-47f3-b74a-5afeb2158c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:01.609169 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4e3e-54e6-47f3-b74a-5afeb2158c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:01.612580 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee4e3e-54e6-47f3-b74a-5afeb2158c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:01.622932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee4e3e-54e6-47f3-b74a-5afeb2158c34 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:01.679030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:01.701917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669d00fd24cd4a8e85b08e0758ab6f4c', 'request_id': 'req-5f37a359-82c5-4e72-b93d-d903f4b2d573'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:01.715635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 673/1341] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:01 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:01.717240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee4e3e-54e6-47f3-b74a-5afeb2158c34 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:01.719628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5dee4e3e-54e6-47f3-b74a-5afeb2158c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:01.727743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669d00fd24cd4a8e85b08e0758ab6f4c', 'request_id': 'req-5f37a359-82c5-4e72-b93d-d903f4b2d573'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:01.741407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669d00fd24cd4a8e85b08e0758ab6f4c', 'request_id': 'req-5f37a359-82c5-4e72-b93d-d903f4b2d573'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:01.804390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] The token cache is being invalidate because project 669d00fd24cd4a8e85b08e0758ab6f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:01.808561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:01.811473 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:01.818418 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 669/1342] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:01 2022] DELETE /identity/v3/projects/669d00fd24cd4a8e85b08e0758ab6f4c => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:01.820735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:01.826141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:01.881648 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee4e3e-54e6-47f3-b74a-5afeb2158c34 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:01.897576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63933ce-e0c7-496c-b9f0-80fae6fb6529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:01.898355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63933ce-e0c7-496c-b9f0-80fae6fb6529 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:01.898717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63933ce-e0c7-496c-b9f0-80fae6fb6529 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:01.899043 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63933ce-e0c7-496c-b9f0-80fae6fb6529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:01.900949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a63933ce-e0c7-496c-b9f0-80fae6fb6529 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:01.980979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:02.035098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37a359-82c5-4e72-b93d-d903f4b2d573 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:02.113750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63933ce-e0c7-496c-b9f0-80fae6fb6529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:02.118744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63933ce-e0c7-496c-b9f0-80fae6fb6529 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:02.162395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 674/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:02.163296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63933ce-e0c7-496c-b9f0-80fae6fb6529 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:02.168441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a63933ce-e0c7-496c-b9f0-80fae6fb6529 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:02.213401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d09dee-fb52-41bf-8e40-5876fe0be82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:02.214191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d09dee-fb52-41bf-8e40-5876fe0be82d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:02.215484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d09dee-fb52-41bf-8e40-5876fe0be82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:02.216721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d09dee-fb52-41bf-8e40-5876fe0be82d admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:02.220001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d09dee-fb52-41bf-8e40-5876fe0be82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:02.224724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d09dee-fb52-41bf-8e40-5876fe0be82d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:02.299122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 670/1344] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:01 2022] POST /identity/v3/users => generated 288 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:02.303722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d09dee-fb52-41bf-8e40-5876fe0be82d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:02.327723 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d09dee-fb52-41bf-8e40-5876fe0be82d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:02.341460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191fda4-b6b3-416c-b029-95d4cc901016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:02.342224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191fda4-b6b3-416c-b029-95d4cc901016 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:02.342803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191fda4-b6b3-416c-b029-95d4cc901016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:02.350739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191fda4-b6b3-416c-b029-95d4cc901016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:02.351706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191fda4-b6b3-416c-b029-95d4cc901016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:02.353496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63933ce-e0c7-496c-b9f0-80fae6fb6529 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:02.355038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191fda4-b6b3-416c-b029-95d4cc901016 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:02.371709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:02.372452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:02.372742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:02.373021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] PATH_INFO: `/v3/users/6698f2d44cd8463bbad39b400e8c94ce` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:02.374229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6698f2d44cd8463bbad39b400e8c94ce)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:02.376211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:02.415305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 671/1345] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:02.419954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191fda4-b6b3-416c-b029-95d4cc901016 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:02.445841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191fda4-b6b3-416c-b029-95d4cc901016 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:02.465998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d485d2-19ea-4676-9249-93c960334c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:02.466899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d485d2-19ea-4676-9249-93c960334c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:02.467421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d485d2-19ea-4676-9249-93c960334c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:02.467974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d485d2-19ea-4676-9249-93c960334c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:02.469614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d485d2-19ea-4676-9249-93c960334c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:02.473799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d485d2-19ea-4676-9249-93c960334c13 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:02.489985 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 672/1346] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:02.494633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d485d2-19ea-4676-9249-93c960334c13 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:02.497379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6698f2d44cd8463bbad39b400e8c94ce'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:02.498065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6698f2d44cd8463bbad39b400e8c94ce'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:02.509478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d485d2-19ea-4676-9249-93c960334c13 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:02.516880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6698f2d44cd8463bbad39b400e8c94ce'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:02.538203 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6698f2d44cd8463bbad39b400e8c94ce'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:02.540995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-51e531f2-6c85-489f-93c1-96de9c869620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6698f2d44cd8463bbad39b400e8c94ce'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:02.549856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e093a91-da18-4a55-9594-edc5cf427511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:02.551412 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093a91-da18-4a55-9594-edc5cf427511 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:02.551703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093a91-da18-4a55-9594-edc5cf427511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:02.554288 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093a91-da18-4a55-9594-edc5cf427511 admin admin] PATH_INFO: `/v3/projects/9a0f3c84f95b4e71a36831b94db9774b/users/a334f267d0e54beebe5e979b9b8536ad/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:02.602833 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 675/1347] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:02 2022] DELETE /identity/v3/users/6698f2d44cd8463bbad39b400e8c94ce => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:02.606860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e093a91-da18-4a55-9594-edc5cf427511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0f3c84f95b4e71a36831b94db9774b, user_id=a334f267d0e54beebe5e979b9b8536ad, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:02.609879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e093a91-da18-4a55-9594-edc5cf427511 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:02.654008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf57ed-c9c6-474d-8032-649bafd9592d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:02.655001 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf57ed-c9c6-474d-8032-649bafd9592d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:02.656103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf57ed-c9c6-474d-8032-649bafd9592d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:02.659777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 673/1348] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:02 2022] PUT /identity/v3/projects/9a0f3c84f95b4e71a36831b94db9774b/users/a334f267d0e54beebe5e979b9b8536ad/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:02.693920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-aeaf57ed-c9c6-474d-8032-649bafd9592d None None] MFA Rules not processed for user `a334f267d0e54beebe5e979b9b8536ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:02.695227 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-aeaf57ed-c9c6-474d-8032-649bafd9592d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:02.760224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:02.813383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e093a91-da18-4a55-9594-edc5cf427511 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:02.816753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2e093a91-da18-4a55-9594-edc5cf427511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:02.820024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 676/1349] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:02.862845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:02.958407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e093a91-da18-4a55-9594-edc5cf427511 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:02.964698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9c5b1-24e0-4e13-bcb0-5e348ec3656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:02.967241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9c5b1-24e0-4e13-bcb0-5e348ec3656b admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:02.967655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9c5b1-24e0-4e13-bcb0-5e348ec3656b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:02.969123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9c5b1-24e0-4e13-bcb0-5e348ec3656b admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:02.970350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9c5b1-24e0-4e13-bcb0-5e348ec3656b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:02.978603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9c5b1-24e0-4e13-bcb0-5e348ec3656b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:03.053009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf57ed-c9c6-474d-8032-649bafd9592d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:03.061475 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 674/1350] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:02 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:03.074241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf57ed-c9c6-474d-8032-649bafd9592d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:03.188223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292420-8af4-4ddd-af9e-db33f5abd45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:03.189553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292420-8af4-4ddd-af9e-db33f5abd45d admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:03.190034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292420-8af4-4ddd-af9e-db33f5abd45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:03.190846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292420-8af4-4ddd-af9e-db33f5abd45d admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:03.191673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74292420-8af4-4ddd-af9e-db33f5abd45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:03.202496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74292420-8af4-4ddd-af9e-db33f5abd45d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:03.242041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 677/1351] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:03 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:03.243230 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9c5b1-24e0-4e13-bcb0-5e348ec3656b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:03.260048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9c5b1-24e0-4e13-bcb0-5e348ec3656b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:03.274827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72d21-12f1-403d-ac2c-dba8728b5b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:03.275801 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72d21-12f1-403d-ac2c-dba8728b5b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:03.276301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72d21-12f1-403d-ac2c-dba8728b5b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:03.276786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72d21-12f1-403d-ac2c-dba8728b5b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:03.277663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e72d21-12f1-403d-ac2c-dba8728b5b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:03.279977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e72d21-12f1-403d-ac2c-dba8728b5b3e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:03.304088 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 675/1352] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:21:03.308648 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292420-8af4-4ddd-af9e-db33f5abd45d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:03.321462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292420-8af4-4ddd-af9e-db33f5abd45d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:03.335019 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3a7f-95b8-4fa2-91ea-0d668a0204c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:03.336123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3a7f-95b8-4fa2-91ea-0d668a0204c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:03.336976 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3a7f-95b8-4fa2-91ea-0d668a0204c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:03.337387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3a7f-95b8-4fa2-91ea-0d668a0204c4 admin admin] PATH_INFO: `/v3/projects/144bc82c80b84fbb8bfa5e2de67d9be2/users/412c30a6889340a0ab7264a01111d224/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:03.385550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3a7f-95b8-4fa2-91ea-0d668a0204c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=144bc82c80b84fbb8bfa5e2de67d9be2, user_id=412c30a6889340a0ab7264a01111d224, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:03.388891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3a7f-95b8-4fa2-91ea-0d668a0204c4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:03.414236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 678/1353] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:03 2022] PUT /identity/v3/projects/144bc82c80b84fbb8bfa5e2de67d9be2/users/412c30a6889340a0ab7264a01111d224/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:03.418642 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72d21-12f1-403d-ac2c-dba8728b5b3e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:03.445464 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72d21-12f1-403d-ac2c-dba8728b5b3e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:03.533412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3a7f-95b8-4fa2-91ea-0d668a0204c4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:03.535960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-273c3a7f-95b8-4fa2-91ea-0d668a0204c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:03.626309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f58ab-3055-4997-a396-698d41dd1fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:03.627016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f58ab-3055-4997-a396-698d41dd1fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:03.627941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f58ab-3055-4997-a396-698d41dd1fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:03.628417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f58ab-3055-4997-a396-698d41dd1fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:03.628935 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f58ab-3055-4997-a396-698d41dd1fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:03.630571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f58ab-3055-4997-a396-698d41dd1fb7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:03.658077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3a7f-95b8-4fa2-91ea-0d668a0204c4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:03.668094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 676/1354] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:03.669711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f58ab-3055-4997-a396-698d41dd1fb7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:03.675195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:03.677273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:03.678157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:03.678623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] PATH_INFO: `/v3/projects/87eebb2d33fd469db4484045024561eb` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:03.680893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87eebb2d33fd469db4484045024561eb)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:03.685062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:03.685529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f58ab-3055-4997-a396-698d41dd1fb7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:03.695337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392136-7d6a-42b2-a569-ac4f322d2887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:03.696237 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392136-7d6a-42b2-a569-ac4f322d2887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:03.696590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392136-7d6a-42b2-a569-ac4f322d2887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:03.697000 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392136-7d6a-42b2-a569-ac4f322d2887 admin admin] PATH_INFO: `/v3/projects/144bc82c80b84fbb8bfa5e2de67d9be2/users/412c30a6889340a0ab7264a01111d224/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:03.699903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83392136-7d6a-42b2-a569-ac4f322d2887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=144bc82c80b84fbb8bfa5e2de67d9be2, user_id=412c30a6889340a0ab7264a01111d224, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:03.707746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83392136-7d6a-42b2-a569-ac4f322d2887 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:03.726367 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 677/1355] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:03 2022] PUT /identity/v3/projects/144bc82c80b84fbb8bfa5e2de67d9be2/users/412c30a6889340a0ab7264a01111d224/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:03.739105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d0ee-9e5c-47f8-89ef-292db6765656 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:03.739611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d0ee-9e5c-47f8-89ef-292db6765656 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:03.740968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d0ee-9e5c-47f8-89ef-292db6765656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:03.797955 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:03.809894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0482d0ee-9e5c-47f8-89ef-292db6765656 None None] MFA Rules not processed for user `412c30a6889340a0ab7264a01111d224`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:03.814545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0482d0ee-9e5c-47f8-89ef-292db6765656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:03.816148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87eebb2d33fd469db4484045024561eb', 'request_id': 'req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:03.830899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87eebb2d33fd469db4484045024561eb', 'request_id': 'req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:03.841272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87eebb2d33fd469db4484045024561eb', 'request_id': 'req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:03.865336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] The token cache is being invalidate because project 87eebb2d33fd469db4484045024561eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:03.865631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:03.870502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c3bc3ee-913b-4e7a-bc63-eb5eb4e22da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:03.876432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 679/1356] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:03 2022] DELETE /identity/v3/projects/87eebb2d33fd469db4484045024561eb => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:03.876432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d3809-fe1f-41af-849f-449000e30b7c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:03.876432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d3809-fe1f-41af-849f-449000e30b7c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:03.876432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d3809-fe1f-41af-849f-449000e30b7c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:03.877825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 680/1357] 10.222.0.23 () {54 vars in 912 bytes} [Fri Oct 21 21:21:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:21:03.878910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d17e1-8b65-4fc0-88c4-4c17ff8c7be0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:03.879193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d17e1-8b65-4fc0-88c4-4c17ff8c7be0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:03.879501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d17e1-8b65-4fc0-88c4-4c17ff8c7be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:03.923837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-555d17e1-8b65-4fc0-88c4-4c17ff8c7be0 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:03.932208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-555d17e1-8b65-4fc0-88c4-4c17ff8c7be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:04.066568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 678/1358] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:04.083616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917d3b7-b6b6-422b-8f93-390fda4eae24 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:04.084240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917d3b7-b6b6-422b-8f93-390fda4eae24 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:04.084918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917d3b7-b6b6-422b-8f93-390fda4eae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:04.109673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:04.193635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 681/1359] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:04.194763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d17e1-8b65-4fc0-88c4-4c17ff8c7be0 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:04.211360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-555d17e1-8b65-4fc0-88c4-4c17ff8c7be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:04.218187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e917d3b7-b6b6-422b-8f93-390fda4eae24 None None] MFA Rules not processed for user `ad7ef5b260e4425c93ebbe85570136db`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:04.219652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e917d3b7-b6b6-422b-8f93-390fda4eae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:04.226822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d17e1-8b65-4fc0-88c4-4c17ff8c7be0 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:04.232646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:04.233975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:04.234273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:04.234546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] PATH_INFO: `/v3/projects/23599590348a479089571a407dcb7527` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:04.235961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23599590348a479089571a407dcb7527)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:04.238471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:04.321382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23599590348a479089571a407dcb7527', 'request_id': 'req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:04.346810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23599590348a479089571a407dcb7527', 'request_id': 'req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:04.356911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23599590348a479089571a407dcb7527', 'request_id': 'req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:04.377909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] The token cache is being invalidate because project 23599590348a479089571a407dcb7527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:04.378535 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:04.379536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:04.379875 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 679/1360] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:04.381051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917d3b7-b6b6-422b-8f93-390fda4eae24 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:04.382698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e917d3b7-b6b6-422b-8f93-390fda4eae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:04.383301 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 682/1361] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:04 2022] DELETE /identity/v3/projects/23599590348a479089571a407dcb7527 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:04.384322 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:04.389301 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:04.469241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:04.509742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a7fbc-d9b8-4f75-9104-14e7413a1e86 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:04.525997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:04.527226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:04.527691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:04.527873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] PATH_INFO: `/v3/projects/16af1ebbeb9d4ff8809f9e26a34c65bd` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:04.529547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16af1ebbeb9d4ff8809f9e26a34c65bd)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:04.531910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:04.578004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917d3b7-b6b6-422b-8f93-390fda4eae24 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:04.646132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16af1ebbeb9d4ff8809f9e26a34c65bd', 'request_id': 'req-7fb1c220-e416-455c-8a71-7aea3d6d9346'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:04.660608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16af1ebbeb9d4ff8809f9e26a34c65bd', 'request_id': 'req-7fb1c220-e416-455c-8a71-7aea3d6d9346'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:04.672084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16af1ebbeb9d4ff8809f9e26a34c65bd', 'request_id': 'req-7fb1c220-e416-455c-8a71-7aea3d6d9346'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:04.693513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7322be-d8c5-434d-93cc-e22b1d25a3c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:04.695967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7322be-d8c5-434d-93cc-e22b1d25a3c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:04.696258 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7322be-d8c5-434d-93cc-e22b1d25a3c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:04.696527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7322be-d8c5-434d-93cc-e22b1d25a3c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:04.702248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] The token cache is being invalidate because project 16af1ebbeb9d4ff8809f9e26a34c65bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:04.702960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:04.704225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6c7322be-d8c5-434d-93cc-e22b1d25a3c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:04.705851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7fb1c220-e416-455c-8a71-7aea3d6d9346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:04.708845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 683/1362] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:04 2022] DELETE /identity/v3/projects/16af1ebbeb9d4ff8809f9e26a34c65bd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:04.714887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f008d-22ae-4671-8a12-d350f60c5baa None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:04.715601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f008d-22ae-4671-8a12-d350f60c5baa None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:04.715948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f008d-22ae-4671-8a12-d350f60c5baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:04.773626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-235f008d-22ae-4671-8a12-d350f60c5baa None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:04.774899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-235f008d-22ae-4671-8a12-d350f60c5baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:04.922610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7322be-d8c5-434d-93cc-e22b1d25a3c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:04.927994 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7322be-d8c5-434d-93cc-e22b1d25a3c3 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:04.930839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 684/1363] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:04.933713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1a0f3-73b3-49c4-9e36-cc76610b9c78 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:04.933713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1a0f3-73b3-49c4-9e36-cc76610b9c78 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:04.935305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1a0f3-73b3-49c4-9e36-cc76610b9c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:04.967425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 680/1364] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:04.968517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7322be-d8c5-434d-93cc-e22b1d25a3c3 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:04.973945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6c7322be-d8c5-434d-93cc-e22b1d25a3c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:04.983468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e5d1a0f3-73b3-49c4-9e36-cc76610b9c78 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:04.984705 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e5d1a0f3-73b3-49c4-9e36-cc76610b9c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:05.003177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 685/1365] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:05.004508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742a53a-700a-4b11-a871-50cc67b9ed2d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.004790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742a53a-700a-4b11-a871-50cc67b9ed2d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.005066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742a53a-700a-4b11-a871-50cc67b9ed2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.023102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:05.062977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b742a53a-700a-4b11-a871-50cc67b9ed2d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:05.064212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b742a53a-700a-4b11-a871-50cc67b9ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:05.117075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 686/1366] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:05.118094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742a53a-700a-4b11-a871-50cc67b9ed2d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:05.145740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742a53a-700a-4b11-a871-50cc67b9ed2d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:05.162867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d6520-b6b1-4835-8f7f-ae242fe535af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:05.163592 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d6520-b6b1-4835-8f7f-ae242fe535af admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.163910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d6520-b6b1-4835-8f7f-ae242fe535af admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.164189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d6520-b6b1-4835-8f7f-ae242fe535af admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.164857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d6520-b6b1-4835-8f7f-ae242fe535af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:05.165160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d6520-b6b1-4835-8f7f-ae242fe535af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:05.166782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d6520-b6b1-4835-8f7f-ae242fe535af admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:05.185360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7322be-d8c5-434d-93cc-e22b1d25a3c3 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:05.208344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 687/1367] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:05.209753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b0199-5e5c-4677-a506-bdaea7d66930 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.210048 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b0199-5e5c-4677-a506-bdaea7d66930 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.210323 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b0199-5e5c-4677-a506-bdaea7d66930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.260601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7d8b0199-5e5c-4677-a506-bdaea7d66930 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:05.261828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7d8b0199-5e5c-4677-a506-bdaea7d66930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:05.294987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 688/1368] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:05.296622 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3f6e-95ef-4c8e-8144-a45689f9b256 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.296872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3f6e-95ef-4c8e-8144-a45689f9b256 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.299154 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3f6e-95ef-4c8e-8144-a45689f9b256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.321688 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ef022-ceac-42bd-b47b-9a484b6bc4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:05.322330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ef022-ceac-42bd-b47b-9a484b6bc4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.322608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ef022-ceac-42bd-b47b-9a484b6bc4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.322891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ef022-ceac-42bd-b47b-9a484b6bc4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.325421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a64ef022-ceac-42bd-b47b-9a484b6bc4b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:05.352162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ef022-ceac-42bd-b47b-9a484b6bc4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:05.355639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ef022-ceac-42bd-b47b-9a484b6bc4b3 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:05.367517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fb6c3f6e-95ef-4c8e-8144-a45689f9b256 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:05.369439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fb6c3f6e-95ef-4c8e-8144-a45689f9b256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:05.376555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 681/1369] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:05.379884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ef022-ceac-42bd-b47b-9a484b6bc4b3 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:05.393979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 689/1370] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:05.398215 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c3f6e-95ef-4c8e-8144-a45689f9b256 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:05.421069 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c3f6e-95ef-4c8e-8144-a45689f9b256 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:05.433300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ef022-ceac-42bd-b47b-9a484b6bc4b3 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:05.433493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262a91f-1ad6-42bb-be0a-abd92f7e7389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:05.434004 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262a91f-1ad6-42bb-be0a-abd92f7e7389 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.434274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262a91f-1ad6-42bb-be0a-abd92f7e7389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.434554 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262a91f-1ad6-42bb-be0a-abd92f7e7389 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.435218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262a91f-1ad6-42bb-be0a-abd92f7e7389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:05.435550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262a91f-1ad6-42bb-be0a-abd92f7e7389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:05.437165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262a91f-1ad6-42bb-be0a-abd92f7e7389 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:05.442343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac68443-2af4-418a-aa23-3c7b38e14776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:05.442979 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac68443-2af4-418a-aa23-3c7b38e14776 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.443262 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac68443-2af4-418a-aa23-3c7b38e14776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.443593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac68443-2af4-418a-aa23-3c7b38e14776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.444287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac68443-2af4-418a-aa23-3c7b38e14776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:05.448727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac68443-2af4-418a-aa23-3c7b38e14776 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:05.460885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 690/1371] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:05.464937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262a91f-1ad6-42bb-be0a-abd92f7e7389 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:05.492714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262a91f-1ad6-42bb-be0a-abd92f7e7389 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:05.506385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc2790-94c9-4bc7-a70b-4e0dbe71ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:05.507020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc2790-94c9-4bc7-a70b-4e0dbe71ab8f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.508187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 682/1372] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:05 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:05.508336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc2790-94c9-4bc7-a70b-4e0dbe71ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.508336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc2790-94c9-4bc7-a70b-4e0dbe71ab8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.508336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc2790-94c9-4bc7-a70b-4e0dbe71ab8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:05.508601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc2790-94c9-4bc7-a70b-4e0dbe71ab8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:05.509789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac68443-2af4-418a-aa23-3c7b38e14776 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:05.510468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc2790-94c9-4bc7-a70b-4e0dbe71ab8f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:05.537053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 691/1373] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:05.541936 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc2790-94c9-4bc7-a70b-4e0dbe71ab8f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:05.566097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc2790-94c9-4bc7-a70b-4e0dbe71ab8f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:05.604508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:05.722466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8dfde-290f-4268-9d69-0ed5163cdb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:05.723159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8dfde-290f-4268-9d69-0ed5163cdb3a admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.723431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8dfde-290f-4268-9d69-0ed5163cdb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.723708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8dfde-290f-4268-9d69-0ed5163cdb3a admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.724493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8dfde-290f-4268-9d69-0ed5163cdb3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:05.726673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8dfde-290f-4268-9d69-0ed5163cdb3a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:05.732739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac68443-2af4-418a-aa23-3c7b38e14776 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:05.754950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b0117-24a8-4232-8094-4c49c243a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:05.759367 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b0117-24a8-4232-8094-4c49c243a4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.760872 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b0117-24a8-4232-8094-4c49c243a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.762597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b0117-24a8-4232-8094-4c49c243a4d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.763449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b0117-24a8-4232-8094-4c49c243a4d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:05.765930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 692/1374] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:05 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:05.767008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8dfde-290f-4268-9d69-0ed5163cdb3a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:05.774907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b0117-24a8-4232-8094-4c49c243a4d3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:05.803983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8dfde-290f-4268-9d69-0ed5163cdb3a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:05.819999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40522e6a-9a8d-4d8a-b860-b39844e624ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:05.828048 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40522e6a-9a8d-4d8a-b860-b39844e624ec admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:05.828465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40522e6a-9a8d-4d8a-b860-b39844e624ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:05.828640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40522e6a-9a8d-4d8a-b860-b39844e624ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:05.829273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40522e6a-9a8d-4d8a-b860-b39844e624ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:05.837258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40522e6a-9a8d-4d8a-b860-b39844e624ec admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:05.849563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 683/1375] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:05 2022] POST /identity/v3/projects => generated 357 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:05.852679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b0117-24a8-4232-8094-4c49c243a4d3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:05.895849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 693/1376] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:05 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:05.899219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40522e6a-9a8d-4d8a-b860-b39844e624ec admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:05.972319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:06.082196 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40522e6a-9a8d-4d8a-b860-b39844e624ec admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.102525 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b0117-24a8-4232-8094-4c49c243a4d3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.103981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431cba-270e-48f0-a850-39714e3c1b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.103981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431cba-270e-48f0-a850-39714e3c1b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.103981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431cba-270e-48f0-a850-39714e3c1b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.103981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431cba-270e-48f0-a850-39714e3c1b2a admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.104332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e431cba-270e-48f0-a850-39714e3c1b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:06.104332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e431cba-270e-48f0-a850-39714e3c1b2a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:06.130300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 694/1377] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:05 2022] POST /identity/v3/users => generated 279 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:06.131216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431cba-270e-48f0-a850-39714e3c1b2a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:06.132981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77513edf-16d0-4360-a24b-49261957584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.134632 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77513edf-16d0-4360-a24b-49261957584c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.137689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77513edf-16d0-4360-a24b-49261957584c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.138190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77513edf-16d0-4360-a24b-49261957584c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.143801 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77513edf-16d0-4360-a24b-49261957584c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:06.148508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431cba-270e-48f0-a850-39714e3c1b2a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.152571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77513edf-16d0-4360-a24b-49261957584c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:06.155484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abd653-e33d-4b4d-a51b-1f86bf2ba684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.156117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abd653-e33d-4b4d-a51b-1f86bf2ba684 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.156398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abd653-e33d-4b4d-a51b-1f86bf2ba684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.156832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abd653-e33d-4b4d-a51b-1f86bf2ba684 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.157692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abd653-e33d-4b4d-a51b-1f86bf2ba684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:06.159874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abd653-e33d-4b4d-a51b-1f86bf2ba684 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:06.196077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 695/1378] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:06 2022] POST /identity/v3/users => generated 302 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:06.197008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abd653-e33d-4b4d-a51b-1f86bf2ba684 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:06.212449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abd653-e33d-4b4d-a51b-1f86bf2ba684 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.217632 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 684/1379] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:06.220517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77513edf-16d0-4360-a24b-49261957584c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:06.221071 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce72757-0e8e-4bbb-b8c7-d346e1fcc0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.221763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce72757-0e8e-4bbb-b8c7-d346e1fcc0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.222595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce72757-0e8e-4bbb-b8c7-d346e1fcc0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.222964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce72757-0e8e-4bbb-b8c7-d346e1fcc0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.226280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce72757-0e8e-4bbb-b8c7-d346e1fcc0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:06.228654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce72757-0e8e-4bbb-b8c7-d346e1fcc0e0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:06.245584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 696/1380] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:06.246553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce72757-0e8e-4bbb-b8c7-d346e1fcc0e0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:06.256374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77513edf-16d0-4360-a24b-49261957584c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.260015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce72757-0e8e-4bbb-b8c7-d346e1fcc0e0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.266726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28351a-3bc1-4232-ba1f-62d01d660e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.267737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28351a-3bc1-4232-ba1f-62d01d660e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.268918 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28351a-3bc1-4232-ba1f-62d01d660e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.269401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28351a-3bc1-4232-ba1f-62d01d660e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.270573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28351a-3bc1-4232-ba1f-62d01d660e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:06.272710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28351a-3bc1-4232-ba1f-62d01d660e02 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:06.279760 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96012ee8-2e2b-4fee-8006-f7638696c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.280433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96012ee8-2e2b-4fee-8006-f7638696c933 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.281737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96012ee8-2e2b-4fee-8006-f7638696c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.282031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96012ee8-2e2b-4fee-8006-f7638696c933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.282700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96012ee8-2e2b-4fee-8006-f7638696c933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:06.292982 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96012ee8-2e2b-4fee-8006-f7638696c933 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:06.311088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 697/1381] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:06.311088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28351a-3bc1-4232-ba1f-62d01d660e02 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:06.329937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 685/1382] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:06.331798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96012ee8-2e2b-4fee-8006-f7638696c933 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:06.347831 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28351a-3bc1-4232-ba1f-62d01d660e02 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.362036 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23de084-238f-4f2f-9151-184f2dc5c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.362912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23de084-238f-4f2f-9151-184f2dc5c80b admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.364209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23de084-238f-4f2f-9151-184f2dc5c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.364612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23de084-238f-4f2f-9151-184f2dc5c80b admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.365436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23de084-238f-4f2f-9151-184f2dc5c80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:06.367165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96012ee8-2e2b-4fee-8006-f7638696c933 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.370864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23de084-238f-4f2f-9151-184f2dc5c80b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:06.387881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d96d0-9790-4349-bb17-218648ad2ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.388620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d96d0-9790-4349-bb17-218648ad2ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.391047 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d96d0-9790-4349-bb17-218648ad2ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.391389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d96d0-9790-4349-bb17-218648ad2ba6 admin admin] PATH_INFO: `/v3/projects/1792969943a5406389bc02e7f3733731/users/d4abc4125c9049ce84f8dd5a245367e3/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.410429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 698/1383] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:06.411702 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23de084-238f-4f2f-9151-184f2dc5c80b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:06.427142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d96d0-9790-4349-bb17-218648ad2ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1792969943a5406389bc02e7f3733731, user_id=d4abc4125c9049ce84f8dd5a245367e3, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:06.433817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d96d0-9790-4349-bb17-218648ad2ba6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:06.444060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23de084-238f-4f2f-9151-184f2dc5c80b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.460589 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 686/1384] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:06 2022] PUT /identity/v3/projects/1792969943a5406389bc02e7f3733731/users/d4abc4125c9049ce84f8dd5a245367e3/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:06.462135 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d96d0-9790-4349-bb17-218648ad2ba6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:06.463332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f50ab5-e25f-44e7-8679-7e14ca09ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.464080 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f50ab5-e25f-44e7-8679-7e14ca09ce26 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.464467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f50ab5-e25f-44e7-8679-7e14ca09ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.464845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f50ab5-e25f-44e7-8679-7e14ca09ce26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.465640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f50ab5-e25f-44e7-8679-7e14ca09ce26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:06.467502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f50ab5-e25f-44e7-8679-7e14ca09ce26 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:06.489140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 699/1385] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:06.498784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521d7f4-28c9-4ad7-b713-9b4413ec66ba None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.501831 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521d7f4-28c9-4ad7-b713-9b4413ec66ba None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.502763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521d7f4-28c9-4ad7-b713-9b4413ec66ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.577309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:06.584377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b521d7f4-28c9-4ad7-b713-9b4413ec66ba None None] MFA Rules not processed for user `d4abc4125c9049ce84f8dd5a245367e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:06.589050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b521d7f4-28c9-4ad7-b713-9b4413ec66ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:06.638111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d96d0-9790-4349-bb17-218648ad2ba6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.649305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85c253-173e-4932-b974-43ac28f15c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.650082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85c253-173e-4932-b974-43ac28f15c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.650436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85c253-173e-4932-b974-43ac28f15c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.650827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85c253-173e-4932-b974-43ac28f15c0c admin admin] PATH_INFO: `/v3/projects/58e9cdfa0768442fb48d65224477992f/users/e7dfa8018ca1476b8e5be53f17dfb990/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.682168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85c253-173e-4932-b974-43ac28f15c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e9cdfa0768442fb48d65224477992f, user_id=e7dfa8018ca1476b8e5be53f17dfb990, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:06.691372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85c253-173e-4932-b974-43ac28f15c0c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:06.740578 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 700/1386] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:06.741344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521d7f4-28c9-4ad7-b713-9b4413ec66ba None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:06.764238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 687/1387] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:06 2022] PUT /identity/v3/projects/58e9cdfa0768442fb48d65224477992f/users/e7dfa8018ca1476b8e5be53f17dfb990/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:06.776349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5d9b6-db9b-4b7f-b9aa-5351e4e9914c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.777616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5d9b6-db9b-4b7f-b9aa-5351e4e9914c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.778066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521d7f4-28c9-4ad7-b713-9b4413ec66ba None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:06.779237 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5d9b6-db9b-4b7f-b9aa-5351e4e9914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.866048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b3c5d9b6-db9b-4b7f-b9aa-5351e4e9914c None None] MFA Rules not processed for user `24211a806cfa4ee6b72c2e7b6074d473`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:06.869666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b3c5d9b6-db9b-4b7f-b9aa-5351e4e9914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:06.962817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292664-2b64-4df8-9392-8fac92c73377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:06.965593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292664-2b64-4df8-9392-8fac92c73377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:06.965879 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292664-2b64-4df8-9392-8fac92c73377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:06.966144 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292664-2b64-4df8-9392-8fac92c73377 admin admin] PATH_INFO: `/v3/projects/98448d1e5d894d28894b6de8b6f82961/users/e5109ab1266940fdb084ece3bb0058ba/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:06.997688 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3292664-2b64-4df8-9392-8fac92c73377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98448d1e5d894d28894b6de8b6f82961, user_id=e5109ab1266940fdb084ece3bb0058ba, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:07.008111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3292664-2b64-4df8-9392-8fac92c73377 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:07.029883 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 701/1388] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:06 2022] PUT /identity/v3/projects/98448d1e5d894d28894b6de8b6f82961/users/e5109ab1266940fdb084ece3bb0058ba/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:07.030817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292664-2b64-4df8-9392-8fac92c73377 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:07.032591 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d3292664-2b64-4df8-9392-8fac92c73377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:07.087654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 688/1389] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:07.088606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5d9b6-db9b-4b7f-b9aa-5351e4e9914c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:07.123524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5d9b6-db9b-4b7f-b9aa-5351e4e9914c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:07.134318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:07.212442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292664-2b64-4df8-9392-8fac92c73377 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:07.226474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada875b-0480-4274-809d-54ccec386d18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa89e84c708f44c299c728284e33fabf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:07.227567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada875b-0480-4274-809d-54ccec386d18 service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:07.228062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada875b-0480-4274-809d-54ccec386d18 service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:07.228521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada875b-0480-4274-809d-54ccec386d18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:07.231750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2ada875b-0480-4274-809d-54ccec386d18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:07.260783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada875b-0480-4274-809d-54ccec386d18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:07.263654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada875b-0480-4274-809d-54ccec386d18 service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:07.296493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 702/1390] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:07.302956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a80dc1-cce3-45d4-bc6e-155423badb3c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:07.303766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a80dc1-cce3-45d4-bc6e-155423badb3c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:07.304308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a80dc1-cce3-45d4-bc6e-155423badb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:07.313106 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c6b5b-380e-44e4-99a9-86eb4b137933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:07.313723 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c6b5b-380e-44e4-99a9-86eb4b137933 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:07.314006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c6b5b-380e-44e4-99a9-86eb4b137933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:07.314320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c6b5b-380e-44e4-99a9-86eb4b137933 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:07.321828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c6b5b-380e-44e4-99a9-86eb4b137933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:07.324054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c6b5b-380e-44e4-99a9-86eb4b137933 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:07.392407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-16a80dc1-cce3-45d4-bc6e-155423badb3c None None] MFA Rules not processed for user `e7dfa8018ca1476b8e5be53f17dfb990`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:07.394515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-16a80dc1-cce3-45d4-bc6e-155423badb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:07.399925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:07.425902 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 689/1391] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:07 2022] POST /identity/v3/projects => generated 369 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:07.426741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2a67-c15e-418b-bffc-c814f145d4e6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:07.427035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2a67-c15e-418b-bffc-c814f145d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:07.427341 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2a67-c15e-418b-bffc-c814f145d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:07.518678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c14d2a67-c15e-418b-bffc-c814f145d4e6 None None] MFA Rules not processed for user `84af08afd232473b8c1c83ac3f0dee3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:07.520211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c14d2a67-c15e-418b-bffc-c814f145d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:07.532602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 703/1392] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:07.534426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea6643-1e47-4543-8653-fe5d33c266cc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:07.534722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea6643-1e47-4543-8653-fe5d33c266cc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:07.538464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea6643-1e47-4543-8653-fe5d33c266cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:07.609203 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-24ea6643-1e47-4543-8653-fe5d33c266cc None None] MFA Rules not processed for user `e5109ab1266940fdb084ece3bb0058ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:07.610609 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-24ea6643-1e47-4543-8653-fe5d33c266cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:07.663925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 690/1393] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:07.668907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2a67-c15e-418b-bffc-c814f145d4e6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:07.672109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c14d2a67-c15e-418b-bffc-c814f145d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:07.762390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 704/1394] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:07.764404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea6643-1e47-4543-8653-fe5d33c266cc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:07.770920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-24ea6643-1e47-4543-8653-fe5d33c266cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:07.826002 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2a67-c15e-418b-bffc-c814f145d4e6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:07.841554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd873fa-2ad2-437b-a223-141983d69edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:07.842370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd873fa-2ad2-437b-a223-141983d69edb service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:07.842668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd873fa-2ad2-437b-a223-141983d69edb service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:07.843105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd873fa-2ad2-437b-a223-141983d69edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:07.932334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:07.970950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea6643-1e47-4543-8653-fe5d33c266cc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:07.982108 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd873fa-2ad2-437b-a223-141983d69edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:07.982989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:07.983835 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd873fa-2ad2-437b-a223-141983d69edb service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:07.984680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:07.986693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:07.987260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] PATH_INFO: `/v3/users/198371c3483a4bf180fe2e12eb628893` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:07.990084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=198371c3483a4bf180fe2e12eb628893)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:07.995708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:08.005168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 691/1395] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:08.006737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e9433-9045-4298-90dd-1d4afcaaf59e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:08.007189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e9433-9045-4298-90dd-1d4afcaaf59e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:08.007662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e9433-9045-4298-90dd-1d4afcaaf59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:08.079567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d51e9433-9045-4298-90dd-1d4afcaaf59e None None] MFA Rules not processed for user `d48b8eb7ac8f43fb92c153ec61b990d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:08.083728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d51e9433-9045-4298-90dd-1d4afcaaf59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:08.089408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:08.108706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '198371c3483a4bf180fe2e12eb628893'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:08.109387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '198371c3483a4bf180fe2e12eb628893'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:08.129603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '198371c3483a4bf180fe2e12eb628893'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:08.141935 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '198371c3483a4bf180fe2e12eb628893'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:08.143410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '198371c3483a4bf180fe2e12eb628893'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:08.213975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 705/1396] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:07 2022] DELETE /identity/v3/users/198371c3483a4bf180fe2e12eb628893 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:08.215243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:08.219971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:08.273829 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 692/1397] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:08.277025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e9433-9045-4298-90dd-1d4afcaaf59e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:08.281338 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d51e9433-9045-4298-90dd-1d4afcaaf59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:08.311131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e9433-9045-4298-90dd-1d4afcaaf59e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:08.425915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c56f6-5582-4c28-a384-0e4bf63b8186 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:08.441616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f935f-aa98-4a77-b7f4-0a26b25e62b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:08.442872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f935f-aa98-4a77-b7f4-0a26b25e62b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:08.442872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f935f-aa98-4a77-b7f4-0a26b25e62b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:08.442872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f935f-aa98-4a77-b7f4-0a26b25e62b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:08.443504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f935f-aa98-4a77-b7f4-0a26b25e62b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:08.445517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f935f-aa98-4a77-b7f4-0a26b25e62b7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:08.452472 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd241b-2b98-43f4-9942-a3fdce30c030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:08.453926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd241b-2b98-43f4-9942-a3fdce30c030 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:08.455138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd241b-2b98-43f4-9942-a3fdce30c030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:08.456347 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd241b-2b98-43f4-9942-a3fdce30c030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:08.457785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd241b-2b98-43f4-9942-a3fdce30c030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:08.463827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd241b-2b98-43f4-9942-a3fdce30c030 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:08.520318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 706/1398] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:08 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:08.521532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f935f-aa98-4a77-b7f4-0a26b25e62b7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:08.534257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bf7f935f-aa98-4a77-b7f4-0a26b25e62b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:08.552733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 693/1399] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:08 2022] POST /identity/v3/projects => generated 355 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:08.554293 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c40fb-4b83-442d-9b52-acfe0a1ce1a2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:08.555020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c40fb-4b83-442d-9b52-acfe0a1ce1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:08.556052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c40fb-4b83-442d-9b52-acfe0a1ce1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:08.572423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f935f-aa98-4a77-b7f4-0a26b25e62b7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:08.615077 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2d5c40fb-4b83-442d-9b52-acfe0a1ce1a2 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:08.650504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2d5c40fb-4b83-442d-9b52-acfe0a1ce1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:08.721213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:08.751505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 694/1400] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:08.753694 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac918f-6df6-4e54-91b2-6ddccd3123b5 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:08.753980 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac918f-6df6-4e54-91b2-6ddccd3123b5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:08.755429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac918f-6df6-4e54-91b2-6ddccd3123b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:08.798495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6aac918f-6df6-4e54-91b2-6ddccd3123b5 None None] MFA Rules not processed for user `d48b8eb7ac8f43fb92c153ec61b990d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:08.800798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6aac918f-6df6-4e54-91b2-6ddccd3123b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:08.843015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c02701-a650-407b-b179-7decc77e389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:08.843749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02701-a650-407b-b179-7decc77e389b admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:08.844030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02701-a650-407b-b179-7decc77e389b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:08.844304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02701-a650-407b-b179-7decc77e389b admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:08.844962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c02701-a650-407b-b179-7decc77e389b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:08.847254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c02701-a650-407b-b179-7decc77e389b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:08.927072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 707/1401] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:08 2022] POST /identity/v3/projects => generated 405 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:08.927556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c02701-a650-407b-b179-7decc77e389b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:08.930821 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-19c02701-a650-407b-b179-7decc77e389b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:08.961102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 695/1402] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:08.967439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac918f-6df6-4e54-91b2-6ddccd3123b5 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:08.997661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac918f-6df6-4e54-91b2-6ddccd3123b5 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:09.036438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:09.109624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c02701-a650-407b-b179-7decc77e389b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:09.141928 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:09.142613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:09.145476 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:09.145760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] PATH_INFO: `/v3/users/a334f267d0e54beebe5e979b9b8536ad` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:09.149949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a334f267d0e54beebe5e979b9b8536ad)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:09.153071 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:09.176991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd309374-8f97-4c9e-ab6f-d1d5745d5d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:09.177666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd309374-8f97-4c9e-ab6f-d1d5745d5d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:09.177880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd309374-8f97-4c9e-ab6f-d1d5745d5d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:09.178152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd309374-8f97-4c9e-ab6f-d1d5745d5d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:09.180248 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd309374-8f97-4c9e-ab6f-d1d5745d5d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:09.185866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd309374-8f97-4c9e-ab6f-d1d5745d5d25 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:09.224865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 696/1403] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:09.226998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8028d-3f67-4f79-ba14-ee20681bde61 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:09.227233 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8028d-3f67-4f79-ba14-ee20681bde61 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:09.228589 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8028d-3f67-4f79-ba14-ee20681bde61 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:09.236831 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 697/1404] 10.222.0.23 () {54 vars in 912 bytes} [Fri Oct 21 21:21:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:21:09.237792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8028d-3f67-4f79-ba14-ee20681bde61 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:09.275521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a334f267d0e54beebe5e979b9b8536ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:09.276772 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a334f267d0e54beebe5e979b9b8536ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:09.280794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8028d-3f67-4f79-ba14-ee20681bde61 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:09.287719 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a334f267d0e54beebe5e979b9b8536ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:09.293723 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9c5d-6505-4f97-8f46-f4b97f0077c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:09.294788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9c5d-6505-4f97-8f46-f4b97f0077c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:09.294977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9c5d-6505-4f97-8f46-f4b97f0077c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:09.295381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9c5d-6505-4f97-8f46-f4b97f0077c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:09.296519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b9c5d-6505-4f97-8f46-f4b97f0077c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:09.298597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b9c5d-6505-4f97-8f46-f4b97f0077c1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:09.320353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a334f267d0e54beebe5e979b9b8536ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:09.321574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a334f267d0e54beebe5e979b9b8536ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:09.343951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 698/1405] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:09 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:09.350695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9c5d-6505-4f97-8f46-f4b97f0077c1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:09.354244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-033b9c5d-6505-4f97-8f46-f4b97f0077c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:09.398468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 708/1406] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:08 2022] DELETE /identity/v3/users/a334f267d0e54beebe5e979b9b8536ad => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:09.400110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:09.403471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:09.520597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9c5d-6505-4f97-8f46-f4b97f0077c1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:09.589338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6542132-e115-499d-aa46-c26aa011ffd7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:09.600322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:09.604081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9634d9-c26d-4147-9419-0960336b5c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:09.604714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9634d9-c26d-4147-9419-0960336b5c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:09.605000 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9634d9-c26d-4147-9419-0960336b5c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:09.605272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9634d9-c26d-4147-9419-0960336b5c98 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:09.605919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9634d9-c26d-4147-9419-0960336b5c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:09.608521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9634d9-c26d-4147-9419-0960336b5c98 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:09.638527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4572132-1aa5-4930-a833-9d4a2020dfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:09.639746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4572132-1aa5-4930-a833-9d4a2020dfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:09.640036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4572132-1aa5-4930-a833-9d4a2020dfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:09.640320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4572132-1aa5-4930-a833-9d4a2020dfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:09.643116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f4572132-1aa5-4930-a833-9d4a2020dfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:09.661817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 709/1407] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:09 2022] POST /identity/v3/users => generated 309 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:09.661817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9634d9-c26d-4147-9419-0960336b5c98 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:09.664821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4572132-1aa5-4930-a833-9d4a2020dfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:09.666848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4572132-1aa5-4930-a833-9d4a2020dfd7 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:09.671369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ab9634d9-c26d-4147-9419-0960336b5c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:09.680128 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 699/1408] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:09.681419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4572132-1aa5-4930-a833-9d4a2020dfd7 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:09.683151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f4572132-1aa5-4930-a833-9d4a2020dfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:09.707653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4572132-1aa5-4930-a833-9d4a2020dfd7 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:09.713715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba53d5-b8d0-4d6b-b88c-2ee7599565b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:09.714697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba53d5-b8d0-4d6b-b88c-2ee7599565b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:09.715188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba53d5-b8d0-4d6b-b88c-2ee7599565b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:09.715772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba53d5-b8d0-4d6b-b88c-2ee7599565b1 admin admin] PATH_INFO: `/v3/projects/f785207da0594d9ea178c496fec6c2af/users/fa08ab018db04b9f97d8d980fb954b29/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:09.733615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba53d5-b8d0-4d6b-b88c-2ee7599565b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f785207da0594d9ea178c496fec6c2af, user_id=fa08ab018db04b9f97d8d980fb954b29, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:09.738033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba53d5-b8d0-4d6b-b88c-2ee7599565b1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:09.759337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 700/1409] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:09 2022] PUT /identity/v3/projects/f785207da0594d9ea178c496fec6c2af/users/fa08ab018db04b9f97d8d980fb954b29/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:09.761010 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06490c8-77c7-48fc-8ed1-805ade329561 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:09.761599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06490c8-77c7-48fc-8ed1-805ade329561 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:09.762747 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06490c8-77c7-48fc-8ed1-805ade329561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:09.802695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b06490c8-77c7-48fc-8ed1-805ade329561 None None] MFA Rules not processed for user `ad7ef5b260e4425c93ebbe85570136db`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:09.805752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b06490c8-77c7-48fc-8ed1-805ade329561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:09.835074 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:09.935093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9634d9-c26d-4147-9419-0960336b5c98 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:09.964435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 701/1410] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:09.965506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06490c8-77c7-48fc-8ed1-805ade329561 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:09.970390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b06490c8-77c7-48fc-8ed1-805ade329561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:10.152125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06490c8-77c7-48fc-8ed1-805ade329561 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:10.157661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d105a7f-a8db-4dc9-8edf-8d3b8a70c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.159819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105a7f-a8db-4dc9-8edf-8d3b8a70c28c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.160335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105a7f-a8db-4dc9-8edf-8d3b8a70c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.160819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105a7f-a8db-4dc9-8edf-8d3b8a70c28c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.162186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d105a7f-a8db-4dc9-8edf-8d3b8a70c28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.164147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d105a7f-a8db-4dc9-8edf-8d3b8a70c28c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:10.177338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff431e8f-1018-419d-9bd8-224c9421c52d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.177999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff431e8f-1018-419d-9bd8-224c9421c52d service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.178264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff431e8f-1018-419d-9bd8-224c9421c52d service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.178532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff431e8f-1018-419d-9bd8-224c9421c52d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.185553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 702/1411] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:10.190564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198472d5-88f7-402d-83c0-e835d81ca494 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.190861 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198472d5-88f7-402d-83c0-e835d81ca494 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.191073 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ff431e8f-1018-419d-9bd8-224c9421c52d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:10.191187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198472d5-88f7-402d-83c0-e835d81ca494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.234575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-198472d5-88f7-402d-83c0-e835d81ca494 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:10.236686 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-198472d5-88f7-402d-83c0-e835d81ca494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:10.259837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 703/1412] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:10.260305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198472d5-88f7-402d-83c0-e835d81ca494 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:10.299116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198472d5-88f7-402d-83c0-e835d81ca494 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:10.323967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6db76a-ae12-4ab5-8bfd-b447d3ee458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.324607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6db76a-ae12-4ab5-8bfd-b447d3ee458f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.324888 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6db76a-ae12-4ab5-8bfd-b447d3ee458f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.325163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6db76a-ae12-4ab5-8bfd-b447d3ee458f admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.326213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6db76a-ae12-4ab5-8bfd-b447d3ee458f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.327708 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6db76a-ae12-4ab5-8bfd-b447d3ee458f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:10.376685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 704/1413] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:10.376941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff431e8f-1018-419d-9bd8-224c9421c52d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.377707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6db76a-ae12-4ab5-8bfd-b447d3ee458f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:10.384258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff431e8f-1018-419d-9bd8-224c9421c52d service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:10.414678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 710/1414] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:10.418221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff431e8f-1018-419d-9bd8-224c9421c52d service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:10.420262 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6db76a-ae12-4ab5-8bfd-b447d3ee458f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:10.421691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ff431e8f-1018-419d-9bd8-224c9421c52d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:10.432749 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899c006-e94a-4b0f-95bd-aeddf1714a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.433371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c006-e94a-4b0f-95bd-aeddf1714a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.433657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c006-e94a-4b0f-95bd-aeddf1714a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.433930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c006-e94a-4b0f-95bd-aeddf1714a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.435954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899c006-e94a-4b0f-95bd-aeddf1714a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.437608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899c006-e94a-4b0f-95bd-aeddf1714a92 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:10.451864 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 705/1415] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:10.451864 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899c006-e94a-4b0f-95bd-aeddf1714a92 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:10.462149 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff431e8f-1018-419d-9bd8-224c9421c52d service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:10.470404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899c006-e94a-4b0f-95bd-aeddf1714a92 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:10.477487 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00ca8d-0e94-41a6-b3f9-63973229e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.480141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00ca8d-0e94-41a6-b3f9-63973229e669 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.481643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00ca8d-0e94-41a6-b3f9-63973229e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.482545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00ca8d-0e94-41a6-b3f9-63973229e669 admin admin] PATH_INFO: `/v3/projects/ea64f2154c0d44a8815ddb7781e35eef/users/8591b644204949f498275e802ceee254/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.493105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9657c4a-9297-41ac-9b3d-1070b722d628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.493748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9657c4a-9297-41ac-9b3d-1070b722d628 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.494023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9657c4a-9297-41ac-9b3d-1070b722d628 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.494304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9657c4a-9297-41ac-9b3d-1070b722d628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.520988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9657c4a-9297-41ac-9b3d-1070b722d628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.524849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9657c4a-9297-41ac-9b3d-1070b722d628 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:10.526478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00ca8d-0e94-41a6-b3f9-63973229e669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea64f2154c0d44a8815ddb7781e35eef, user_id=8591b644204949f498275e802ceee254, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.531083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00ca8d-0e94-41a6-b3f9-63973229e669 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:10.543291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 711/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:10.544298 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9657c4a-9297-41ac-9b3d-1070b722d628 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:10.547418 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:10.554411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9657c4a-9297-41ac-9b3d-1070b722d628 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:10.556164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 706/1417] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:10 2022] PUT /identity/v3/projects/ea64f2154c0d44a8815ddb7781e35eef/users/8591b644204949f498275e802ceee254/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:10.562134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00ca8d-0e94-41a6-b3f9-63973229e669 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:10.671946 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c01596-cd32-424a-8a75-9f2d4422b358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.675584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c01596-cd32-424a-8a75-9f2d4422b358 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.676118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c01596-cd32-424a-8a75-9f2d4422b358 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.676631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c01596-cd32-424a-8a75-9f2d4422b358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.693385 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00ca8d-0e94-41a6-b3f9-63973229e669 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:10.696825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c01596-cd32-424a-8a75-9f2d4422b358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.699131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c01596-cd32-424a-8a75-9f2d4422b358 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:10.704662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c499c3a-3262-403f-850e-05c30608f0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.707137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c499c3a-3262-403f-850e-05c30608f0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.707407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c499c3a-3262-403f-850e-05c30608f0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.707731 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c499c3a-3262-403f-850e-05c30608f0d1 admin admin] PATH_INFO: `/v3/projects/ecc6a17394a1493c97449e800903aa30/users/8b93b40d818b4407a60846730b1387de/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.714268 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 712/1418] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:10.716456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c01596-cd32-424a-8a75-9f2d4422b358 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:10.723142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:10.734084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c01596-cd32-424a-8a75-9f2d4422b358 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:10.749259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75638e08-ad20-4576-9ae4-42a86751c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.750206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75638e08-ad20-4576-9ae4-42a86751c6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.751055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75638e08-ad20-4576-9ae4-42a86751c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.751055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75638e08-ad20-4576-9ae4-42a86751c6ae admin admin] PATH_INFO: `/v3/projects/f785207da0594d9ea178c496fec6c2af/users/fa08ab018db04b9f97d8d980fb954b29/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.755882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75638e08-ad20-4576-9ae4-42a86751c6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f785207da0594d9ea178c496fec6c2af, user_id=fa08ab018db04b9f97d8d980fb954b29, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.760385 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c499c3a-3262-403f-850e-05c30608f0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc6a17394a1493c97449e800903aa30, user_id=8b93b40d818b4407a60846730b1387de, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.763066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c499c3a-3262-403f-850e-05c30608f0d1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:10.764833 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75638e08-ad20-4576-9ae4-42a86751c6ae admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:10.789790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 707/1420] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:10 2022] PUT /identity/v3/projects/ecc6a17394a1493c97449e800903aa30/users/8b93b40d818b4407a60846730b1387de/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:10.791037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c499c3a-3262-403f-850e-05c30608f0d1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:10.799654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 713/1420] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:10 2022] PUT /identity/v3/projects/f785207da0594d9ea178c496fec6c2af/users/fa08ab018db04b9f97d8d980fb954b29/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:10.800241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5c499c3a-3262-403f-850e-05c30608f0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:10.800359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75638e08-ad20-4576-9ae4-42a86751c6ae admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:10.902311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75638e08-ad20-4576-9ae4-42a86751c6ae admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:10.918025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4fc3-27c6-4308-bc37-6bf66938e5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.922017 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4fc3-27c6-4308-bc37-6bf66938e5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.922529 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4fc3-27c6-4308-bc37-6bf66938e5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.922805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4fc3-27c6-4308-bc37-6bf66938e5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.923524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d4fc3-27c6-4308-bc37-6bf66938e5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.927228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c499c3a-3262-403f-850e-05c30608f0d1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:10.930950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d4fc3-27c6-4308-bc37-6bf66938e5d3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:10.958646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:10.959241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 714/1421] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:10.960502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.960999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.961882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] PATH_INFO: `/v3/projects/055d8bd0d84d472dabc4764c6e18c75e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.963453 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e8e70-1cc9-40ac-9971-421f255d67e2 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:10.963841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e8e70-1cc9-40ac-9971-421f255d67e2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:10.964198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e8e70-1cc9-40ac-9971-421f255d67e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:10.967421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=055d8bd0d84d472dabc4764c6e18c75e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:10.972797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:11.051028 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0c0e8e70-1cc9-40ac-9971-421f255d67e2 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:11.052131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0c0e8e70-1cc9-40ac-9971-421f255d67e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:11.071727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055d8bd0d84d472dabc4764c6e18c75e', 'request_id': 'req-a6b8d214-8ec2-4087-8168-88f1aee49dcd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:11.091876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055d8bd0d84d472dabc4764c6e18c75e', 'request_id': 'req-a6b8d214-8ec2-4087-8168-88f1aee49dcd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:11.102298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055d8bd0d84d472dabc4764c6e18c75e', 'request_id': 'req-a6b8d214-8ec2-4087-8168-88f1aee49dcd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:11.119413 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] The token cache is being invalidate because project 055d8bd0d84d472dabc4764c6e18c75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:11.119716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:11.120426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:11.126385 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 708/1422] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:10 2022] DELETE /identity/v3/projects/055d8bd0d84d472dabc4764c6e18c75e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:11.128141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:11.129696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:11.149024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:11.164919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 715/1423] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:11.166543 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3240-c724-47c9-bfa0-8c371b30259a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:11.166836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3240-c724-47c9-bfa0-8c371b30259a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:11.167111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3240-c724-47c9-bfa0-8c371b30259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:11.201900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-51ae3240-c724-47c9-bfa0-8c371b30259a None None] MFA Rules not processed for user `fa08ab018db04b9f97d8d980fb954b29`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:11.203141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-51ae3240-c724-47c9-bfa0-8c371b30259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:11.235049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d214-8ec2-4087-8168-88f1aee49dcd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:11.241940 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbc3f2-7646-455b-9833-a6b04ea4809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:11.242673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc3f2-7646-455b-9833-a6b04ea4809e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:11.243548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc3f2-7646-455b-9833-a6b04ea4809e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:11.243926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc3f2-7646-455b-9833-a6b04ea4809e admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:11.244685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbc3f2-7646-455b-9833-a6b04ea4809e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:11.246502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbc3f2-7646-455b-9833-a6b04ea4809e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:11.258214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 709/1424] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:11.259427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbc3f2-7646-455b-9833-a6b04ea4809e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:11.262783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-93bbc3f2-7646-455b-9833-a6b04ea4809e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:11.268701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:11.280580 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbc3f2-7646-455b-9833-a6b04ea4809e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:11.286434 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1497c-1aaf-4841-b390-eb4224640fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:11.287334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1497c-1aaf-4841-b390-eb4224640fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:11.287612 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1497c-1aaf-4841-b390-eb4224640fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:11.288117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1497c-1aaf-4841-b390-eb4224640fc1 admin admin] PATH_INFO: `/v3/projects/ea64f2154c0d44a8815ddb7781e35eef/users/8591b644204949f498275e802ceee254/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:11.290213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1497c-1aaf-4841-b390-eb4224640fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea64f2154c0d44a8815ddb7781e35eef, user_id=8591b644204949f498275e802ceee254, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:11.293171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1497c-1aaf-4841-b390-eb4224640fc1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:11.297645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 716/1425] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:11.298493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3240-c724-47c9-bfa0-8c371b30259a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:11.300510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-51ae3240-c724-47c9-bfa0-8c371b30259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:11.325214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 710/1426] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:11 2022] PUT /identity/v3/projects/ea64f2154c0d44a8815ddb7781e35eef/users/8591b644204949f498275e802ceee254/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:11.327783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3240-c724-47c9-bfa0-8c371b30259a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:11.332012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4b108-56ce-49d3-abe4-ea7767829d06 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:11.332312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4b108-56ce-49d3-abe4-ea7767829d06 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:11.333233 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4b108-56ce-49d3-abe4-ea7767829d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:11.438881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-09b4b108-56ce-49d3-abe4-ea7767829d06 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:11.441998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-09b4b108-56ce-49d3-abe4-ea7767829d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:11.526208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:11.526863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:11.527138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:11.527478 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] PATH_INFO: `/v3/projects/9a0f3c84f95b4e71a36831b94db9774b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:11.528658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0f3c84f95b4e71a36831b94db9774b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:11.530572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:11.591809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 711/1427] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:11.592468 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4b108-56ce-49d3-abe4-ea7767829d06 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:11.609360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4b108-56ce-49d3-abe4-ea7767829d06 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:11.625824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0f3c84f95b4e71a36831b94db9774b', 'request_id': 'req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:11.633416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0f3c84f95b4e71a36831b94db9774b', 'request_id': 'req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:11.641665 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0f3c84f95b4e71a36831b94db9774b', 'request_id': 'req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:11.662335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] The token cache is being invalidate because project 9a0f3c84f95b4e71a36831b94db9774b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:11.662750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:11.664167 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:11.666200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 717/1428] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:11 2022] DELETE /identity/v3/projects/9a0f3c84f95b4e71a36831b94db9774b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:11.668726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:11.672778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:11.769134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549d4d6-8b42-4fa8-948f-94ef09455c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:11.769930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549d4d6-8b42-4fa8-948f-94ef09455c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:11.770283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549d4d6-8b42-4fa8-948f-94ef09455c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:11.770626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549d4d6-8b42-4fa8-948f-94ef09455c9a admin admin] PATH_INFO: `/v3/projects/ecc6a17394a1493c97449e800903aa30/users/8b93b40d818b4407a60846730b1387de/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:11.773503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549d4d6-8b42-4fa8-948f-94ef09455c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc6a17394a1493c97449e800903aa30, user_id=8b93b40d818b4407a60846730b1387de, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:11.776537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549d4d6-8b42-4fa8-948f-94ef09455c9a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:11.790253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 712/1429] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:11 2022] PUT /identity/v3/projects/ecc6a17394a1493c97449e800903aa30/users/8b93b40d818b4407a60846730b1387de/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:11.791628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85715-0157-421e-ab51-81c12a97c110 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:11.791913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85715-0157-421e-ab51-81c12a97c110 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:11.792186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85715-0157-421e-ab51-81c12a97c110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:11.800676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0f77a-6118-47b3-a8ce-3d93db1ce466 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:11.876240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:11.878543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7ee85715-0157-421e-ab51-81c12a97c110 None None] MFA Rules not processed for user `8591b644204949f498275e802ceee254`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:11.880105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7ee85715-0157-421e-ab51-81c12a97c110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:11.914629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:11.945620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee0b62-9842-475a-99cf-811520930e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:11.946869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee0b62-9842-475a-99cf-811520930e1b service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:11.947640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee0b62-9842-475a-99cf-811520930e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:11.948125 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee0b62-9842-475a-99cf-811520930e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:11.950262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7dee0b62-9842-475a-99cf-811520930e1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:12.003669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 713/1430] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:12.003669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee85715-0157-421e-ab51-81c12a97c110 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:12.003669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7ee85715-0157-421e-ab51-81c12a97c110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:12.099844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee0b62-9842-475a-99cf-811520930e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:12.101570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee0b62-9842-475a-99cf-811520930e1b service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:12.127911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 718/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:12.130111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47af8-4f7f-44be-9e1b-b91e2cfb7ada None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:12.130812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47af8-4f7f-44be-9e1b-b91e2cfb7ada None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:12.132871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47af8-4f7f-44be-9e1b-b91e2cfb7ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:12.190859 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6fa47af8-4f7f-44be-9e1b-b91e2cfb7ada None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:12.193045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6fa47af8-4f7f-44be-9e1b-b91e2cfb7ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:12.239172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee85715-0157-421e-ab51-81c12a97c110 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:12.249531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa810c7-a6e4-4b2a-b926-c619b2426ef4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:12.250171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa810c7-a6e4-4b2a-b926-c619b2426ef4 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:12.250453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa810c7-a6e4-4b2a-b926-c619b2426ef4 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:12.250729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa810c7-a6e4-4b2a-b926-c619b2426ef4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:12.252747 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7aa810c7-a6e4-4b2a-b926-c619b2426ef4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:12.319389 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 719/1432] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:12.320881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa47af8-4f7f-44be-9e1b-b91e2cfb7ada None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:12.323292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6fa47af8-4f7f-44be-9e1b-b91e2cfb7ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:12.344682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa810c7-a6e4-4b2a-b926-c619b2426ef4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:12.347008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa810c7-a6e4-4b2a-b926-c619b2426ef4 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:12.362298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 714/1433] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:21:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:21:12.364165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b7917-42bf-40e8-abf2-7b7e53df2d98 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:12.364473 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b7917-42bf-40e8-abf2-7b7e53df2d98 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:12.365042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b7917-42bf-40e8-abf2-7b7e53df2d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:12.373334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa47af8-4f7f-44be-9e1b-b91e2cfb7ada None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:12.382947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:12.383994 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:12.384380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:12.384919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] PATH_INFO: `/v3/users/412c30a6889340a0ab7264a01111d224` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:12.386165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=412c30a6889340a0ab7264a01111d224)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:12.388389 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:12.405783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c84b7917-42bf-40e8-abf2-7b7e53df2d98 None None] MFA Rules not processed for user `8b93b40d818b4407a60846730b1387de`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:12.407290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c84b7917-42bf-40e8-abf2-7b7e53df2d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:12.466638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:12.512391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412c30a6889340a0ab7264a01111d224'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:12.513269 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412c30a6889340a0ab7264a01111d224'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:12.529963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412c30a6889340a0ab7264a01111d224'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:12.548293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412c30a6889340a0ab7264a01111d224'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:12.550277 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412c30a6889340a0ab7264a01111d224'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:12.588133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:12.625815 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 720/1434] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:12 2022] DELETE /identity/v3/users/412c30a6889340a0ab7264a01111d224 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:12.625815 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:12.626152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 715/1435] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:12.626152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b7917-42bf-40e8-abf2-7b7e53df2d98 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:12.628082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:12.629365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c84b7917-42bf-40e8-abf2-7b7e53df2d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:12.659550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b7917-42bf-40e8-abf2-7b7e53df2d98 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:12.849393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b71c83-9a08-4a88-9758-cd5b0b1d3d0c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:12.866509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34a02c-8d24-4d22-8255-8006960e06d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:12.870659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34a02c-8d24-4d22-8255-8006960e06d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:12.872352 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34a02c-8d24-4d22-8255-8006960e06d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:12.872953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34a02c-8d24-4d22-8255-8006960e06d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:12.877863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c36c56-a4ae-4f11-ae6d-cb330ae01c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:12.878503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c36c56-a4ae-4f11-ae6d-cb330ae01c44 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:12.882454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ac34a02c-8d24-4d22-8255-8006960e06d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:12.884464 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c36c56-a4ae-4f11-ae6d-cb330ae01c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:12.884981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c36c56-a4ae-4f11-ae6d-cb330ae01c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:12.890259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-79c36c56-a4ae-4f11-ae6d-cb330ae01c44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:13.139989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c36c56-a4ae-4f11-ae6d-cb330ae01c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:13.144628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c36c56-a4ae-4f11-ae6d-cb330ae01c44 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:13.152056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34a02c-8d24-4d22-8255-8006960e06d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:13.153744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34a02c-8d24-4d22-8255-8006960e06d4 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:13.192552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 716/1436] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:13.193833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c36c56-a4ae-4f11-ae6d-cb330ae01c44 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:13.205883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-79c36c56-a4ae-4f11-ae6d-cb330ae01c44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:13.212042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 721/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:13.333431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34a02c-8d24-4d22-8255-8006960e06d4 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:13.345618 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34a02c-8d24-4d22-8255-8006960e06d4 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:13.360798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4e21d-2dd3-422c-9069-4cee4e6c544f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:13.364138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4e21d-2dd3-422c-9069-4cee4e6c544f service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:13.364729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4e21d-2dd3-422c-9069-4cee4e6c544f service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:13.366180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4e21d-2dd3-422c-9069-4cee4e6c544f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:13.485320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c36c56-a4ae-4f11-ae6d-cb330ae01c44 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:13.496439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e962b-e51d-4db7-b1f0-7bb725000d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:13.498734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e962b-e51d-4db7-b1f0-7bb725000d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:13.499671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e962b-e51d-4db7-b1f0-7bb725000d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:13.500517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e962b-e51d-4db7-b1f0-7bb725000d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:13.504031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e962b-e51d-4db7-b1f0-7bb725000d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:13.505476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e962b-e51d-4db7-b1f0-7bb725000d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:13.512096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e962b-e51d-4db7-b1f0-7bb725000d50 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:13.545874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 717/1438] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:13.553680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e962b-e51d-4db7-b1f0-7bb725000d50 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:13.581129 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e962b-e51d-4db7-b1f0-7bb725000d50 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:13.604400 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc8b78-dd5b-4e78-bd34-e808ef875656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:13.605066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc8b78-dd5b-4e78-bd34-e808ef875656 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:13.605608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc8b78-dd5b-4e78-bd34-e808ef875656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:13.607045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc8b78-dd5b-4e78-bd34-e808ef875656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:13.607811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc8b78-dd5b-4e78-bd34-e808ef875656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:13.617054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc8b78-dd5b-4e78-bd34-e808ef875656 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:13.646098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:13.698759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4e21d-2dd3-422c-9069-4cee4e6c544f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:13.704114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4e21d-2dd3-422c-9069-4cee4e6c544f service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:13.730245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 718/1439] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:13 2022] POST /identity/v3/projects => generated 363 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:13.732536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc8b78-dd5b-4e78-bd34-e808ef875656 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:13.743664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1adc8b78-dd5b-4e78-bd34-e808ef875656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:13.774916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 722/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:13 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:13.775881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4e21d-2dd3-422c-9069-4cee4e6c544f service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:13.793836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4e21d-2dd3-422c-9069-4cee4e6c544f service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:13.961697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc8b78-dd5b-4e78-bd34-e808ef875656 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:14.000656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:14.000968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:14.000968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:14.000968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:14.000968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] PATH_INFO: `/v3/projects/144bc82c80b84fbb8bfa5e2de67d9be2` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:14.001313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=144bc82c80b84fbb8bfa5e2de67d9be2)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:14.056659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:14.201446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e11f5b-6707-41d8-83c5-9be2772cc6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:14.204860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11f5b-6707-41d8-83c5-9be2772cc6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:14.212421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11f5b-6707-41d8-83c5-9be2772cc6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:14.213687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11f5b-6707-41d8-83c5-9be2772cc6b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:14.216372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e11f5b-6707-41d8-83c5-9be2772cc6b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:14.241995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e11f5b-6707-41d8-83c5-9be2772cc6b5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:14.306638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '144bc82c80b84fbb8bfa5e2de67d9be2', 'request_id': 'req-ff95f4cb-b026-4242-b593-2e4d4dc10801'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:14.335918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '144bc82c80b84fbb8bfa5e2de67d9be2', 'request_id': 'req-ff95f4cb-b026-4242-b593-2e4d4dc10801'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:14.342441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 723/1441] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:13 2022] POST /identity/v3/users => generated 282 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:14.346753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e11f5b-6707-41d8-83c5-9be2772cc6b5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:14.381811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '144bc82c80b84fbb8bfa5e2de67d9be2', 'request_id': 'req-ff95f4cb-b026-4242-b593-2e4d4dc10801'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:14.420196 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] The token cache is being invalidate because project 144bc82c80b84fbb8bfa5e2de67d9be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:14.421091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:14.425124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:14.430261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 719/1442] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:13 2022] DELETE /identity/v3/projects/144bc82c80b84fbb8bfa5e2de67d9be2 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:14.439433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:14.439433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:14.561181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e11f5b-6707-41d8-83c5-9be2772cc6b5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:14.710099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95f4cb-b026-4242-b593-2e4d4dc10801 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:14.728432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181a5f-34e1-44c5-988f-a8fa038cef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:14.729156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181a5f-34e1-44c5-988f-a8fa038cef6e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:14.729442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181a5f-34e1-44c5-988f-a8fa038cef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:14.729764 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181a5f-34e1-44c5-988f-a8fa038cef6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:14.730409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae181a5f-34e1-44c5-988f-a8fa038cef6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:14.732315 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae181a5f-34e1-44c5-988f-a8fa038cef6e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:14.790930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdda62-9104-46f5-b566-0f76ce602853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:14.791595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdda62-9104-46f5-b566-0f76ce602853 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:14.791881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdda62-9104-46f5-b566-0f76ce602853 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:14.792236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdda62-9104-46f5-b566-0f76ce602853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:14.794588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 720/1443] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:14.797014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181a5f-34e1-44c5-988f-a8fa038cef6e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:14.801714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a1fdda62-9104-46f5-b566-0f76ce602853 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:14.803628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ae181a5f-34e1-44c5-988f-a8fa038cef6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:14.818730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181a5f-34e1-44c5-988f-a8fa038cef6e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:14.853402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:14.854062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:14.854349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:14.854615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] PATH_INFO: `/v3/users/e5109ab1266940fdb084ece3bb0058ba` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:14.856680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5109ab1266940fdb084ece3bb0058ba)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:14.861075 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:14.920020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:15.035544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5109ab1266940fdb084ece3bb0058ba'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:15.038883 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdda62-9104-46f5-b566-0f76ce602853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:15.052666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdda62-9104-46f5-b566-0f76ce602853 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:15.080733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5109ab1266940fdb084ece3bb0058ba'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:15.097805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 724/1444] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:15.099208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eafc4-30e5-469f-9f92-474e70efc01e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:15.105546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5109ab1266940fdb084ece3bb0058ba'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:15.113696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eafc4-30e5-469f-9f92-474e70efc01e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:15.114008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eafc4-30e5-469f-9f92-474e70efc01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:15.138393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5109ab1266940fdb084ece3bb0058ba'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:15.139150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5109ab1266940fdb084ece3bb0058ba'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:15.147789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 721/1445] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:14 2022] DELETE /identity/v3/users/e5109ab1266940fdb084ece3bb0058ba => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:15.148712 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:15.150345 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:15.156723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-2b8eafc4-30e5-469f-9f92-474e70efc01e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:15.158839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2b8eafc4-30e5-469f-9f92-474e70efc01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:15.233021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:15.286255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 725/1446] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:15.287561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa7e68-c86b-4297-9dce-f3b6e276f336 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:15.287855 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa7e68-c86b-4297-9dce-f3b6e276f336 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:15.288194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa7e68-c86b-4297-9dce-f3b6e276f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:15.332304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8ffa7e68-c86b-4297-9dce-f3b6e276f336 None None] MFA Rules not processed for user `24211a806cfa4ee6b72c2e7b6074d473`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:15.333714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8ffa7e68-c86b-4297-9dce-f3b6e276f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:15.370967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6b64d-f0e2-47bf-bb58-bc4319a58487 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:15.384356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9533b-3079-4aa0-9e11-8ec9967fe6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:15.385647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9533b-3079-4aa0-9e11-8ec9967fe6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:15.386023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9533b-3079-4aa0-9e11-8ec9967fe6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:15.386451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9533b-3079-4aa0-9e11-8ec9967fe6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:15.393017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9533b-3079-4aa0-9e11-8ec9967fe6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:15.395063 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9533b-3079-4aa0-9e11-8ec9967fe6b7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:15.416748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 722/1447] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:15.418358 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b5b92-f377-4b1e-8478-7557de404d88 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:15.418940 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b5b92-f377-4b1e-8478-7557de404d88 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:15.419548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b5b92-f377-4b1e-8478-7557de404d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:15.477643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-eb9b5b92-f377-4b1e-8478-7557de404d88 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:15.479693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-eb9b5b92-f377-4b1e-8478-7557de404d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:15.500269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 723/1448] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:15.501570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b62fc-89fb-4c9f-9b75-2b23fa67d0a2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:15.502481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b62fc-89fb-4c9f-9b75-2b23fa67d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:15.502800 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b62fc-89fb-4c9f-9b75-2b23fa67d0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:15.542966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8b0b62fc-89fb-4c9f-9b75-2b23fa67d0a2 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:15.547548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8b0b62fc-89fb-4c9f-9b75-2b23fa67d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:15.560063 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 724/1449] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:15.561250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b62fc-89fb-4c9f-9b75-2b23fa67d0a2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:15.578996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 726/1450] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:15.578996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dbed0-9294-4282-9221-59445cd1b8cf None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:15.578996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dbed0-9294-4282-9221-59445cd1b8cf None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:15.578996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dbed0-9294-4282-9221-59445cd1b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:15.589186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b62fc-89fb-4c9f-9b75-2b23fa67d0a2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:15.608174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fe7dbed0-9294-4282-9221-59445cd1b8cf None None] MFA Rules not processed for user `ad7ef5b260e4425c93ebbe85570136db`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:15.610368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fe7dbed0-9294-4282-9221-59445cd1b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:15.611105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642308d5-e42f-458d-88f0-b5cad085bcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:15.617637 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642308d5-e42f-458d-88f0-b5cad085bcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:15.617918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642308d5-e42f-458d-88f0-b5cad085bcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:15.618199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642308d5-e42f-458d-88f0-b5cad085bcf7 admin admin] PATH_INFO: `/v3/projects/7ed39193ba7f4af6903fdcb758010131/users/d4bb2c68b9c44a15b6b1d5c3cf015482/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:15.701218 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642308d5-e42f-458d-88f0-b5cad085bcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed39193ba7f4af6903fdcb758010131, user_id=d4bb2c68b9c44a15b6b1d5c3cf015482, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:15.708467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642308d5-e42f-458d-88f0-b5cad085bcf7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:15.773474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 725/1451] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:15 2022] PUT /identity/v3/projects/7ed39193ba7f4af6903fdcb758010131/users/d4bb2c68b9c44a15b6b1d5c3cf015482/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:15.773474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642308d5-e42f-458d-88f0-b5cad085bcf7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:15.790638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-642308d5-e42f-458d-88f0-b5cad085bcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:15.791155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 727/1452] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Oct 21 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:15.792440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dbed0-9294-4282-9221-59445cd1b8cf None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:15.815710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dbed0-9294-4282-9221-59445cd1b8cf None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:15.906140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fcebf-cdaf-4e14-bb5c-31b59d77139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:15.909188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fcebf-cdaf-4e14-bb5c-31b59d77139f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:15.909730 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fcebf-cdaf-4e14-bb5c-31b59d77139f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:15.910257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fcebf-cdaf-4e14-bb5c-31b59d77139f admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:15.912563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fcebf-cdaf-4e14-bb5c-31b59d77139f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:15.915126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fcebf-cdaf-4e14-bb5c-31b59d77139f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:15.918489 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fcebf-cdaf-4e14-bb5c-31b59d77139f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:15.946172 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 728/1453] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:15.948021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd92ab-44e4-452e-9f28-b497259f156d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:15.948432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd92ab-44e4-452e-9f28-b497259f156d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:15.948824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd92ab-44e4-452e-9f28-b497259f156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:15.957245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:15.995611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642308d5-e42f-458d-88f0-b5cad085bcf7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:16.007452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-14cd92ab-44e4-452e-9f28-b497259f156d None None] MFA Rules not processed for user `d4bb2c68b9c44a15b6b1d5c3cf015482`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:16.013739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-14cd92ab-44e4-452e-9f28-b497259f156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:16.017863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940282c1-6664-43fc-ad47-c5976e39a086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:16.018186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940282c1-6664-43fc-ad47-c5976e39a086 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:16.018468 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940282c1-6664-43fc-ad47-c5976e39a086 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:16.018741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940282c1-6664-43fc-ad47-c5976e39a086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:16.059628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940282c1-6664-43fc-ad47-c5976e39a086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:16.061092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940282c1-6664-43fc-ad47-c5976e39a086 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:16.076524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:16.117300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 726/1454] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:16.118415 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940282c1-6664-43fc-ad47-c5976e39a086 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:16.152056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940282c1-6664-43fc-ad47-c5976e39a086 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:16.170903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da06ba-56b4-4357-8ddc-e09ef2c9f30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:16.171567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da06ba-56b4-4357-8ddc-e09ef2c9f30a service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:16.171853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da06ba-56b4-4357-8ddc-e09ef2c9f30a service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:16.172133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da06ba-56b4-4357-8ddc-e09ef2c9f30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:16.197208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 729/1455] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:16.198491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd92ab-44e4-452e-9f28-b497259f156d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:16.199242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da06ba-56b4-4357-8ddc-e09ef2c9f30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:16.201300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da06ba-56b4-4357-8ddc-e09ef2c9f30a service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:16.216430 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd92ab-44e4-452e-9f28-b497259f156d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:16.225659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d1f87-7083-4dfb-b53d-4d96751f229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:16.226656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1f87-7083-4dfb-b53d-4d96751f229b admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:16.228725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1f87-7083-4dfb-b53d-4d96751f229b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:16.228924 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 727/1456] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:16.229177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1f87-7083-4dfb-b53d-4d96751f229b admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:16.229819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da06ba-56b4-4357-8ddc-e09ef2c9f30a service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:16.231926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d1f87-7083-4dfb-b53d-4d96751f229b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:16.235381 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d1f87-7083-4dfb-b53d-4d96751f229b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:16.293891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da06ba-56b4-4357-8ddc-e09ef2c9f30a service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:16.316033 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 730/1457] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:16 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:16.317590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d1f87-7083-4dfb-b53d-4d96751f229b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:16.324046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d73302-76b5-4441-8d52-f637871c716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:16.324704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73302-76b5-4441-8d52-f637871c716a admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:16.325084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73302-76b5-4441-8d52-f637871c716a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:16.325432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73302-76b5-4441-8d52-f637871c716a admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:16.326346 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d73302-76b5-4441-8d52-f637871c716a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:16.328702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d73302-76b5-4441-8d52-f637871c716a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:16.436496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 728/1458] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:16 2022] POST /identity/v3/projects => generated 363 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:16.440108 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d73302-76b5-4441-8d52-f637871c716a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:16.547521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d1f87-7083-4dfb-b53d-4d96751f229b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:16.575903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d73302-76b5-4441-8d52-f637871c716a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:16.582480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadea54-a40b-426f-b4c7-f00d90fcc212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:16.583140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadea54-a40b-426f-b4c7-f00d90fcc212 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:16.583519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadea54-a40b-426f-b4c7-f00d90fcc212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:16.583897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadea54-a40b-426f-b4c7-f00d90fcc212 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:16.585241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadea54-a40b-426f-b4c7-f00d90fcc212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:16.588043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadea54-a40b-426f-b4c7-f00d90fcc212 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:16.661888 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 729/1459] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:16 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:16.665556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadea54-a40b-426f-b4c7-f00d90fcc212 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:16.687700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadea54-a40b-426f-b4c7-f00d90fcc212 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:16.698887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16f952-0843-4742-a181-e7f2367cd489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:16.699672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16f952-0843-4742-a181-e7f2367cd489 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:16.701310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16f952-0843-4742-a181-e7f2367cd489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:16.701716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16f952-0843-4742-a181-e7f2367cd489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:16.702368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16f952-0843-4742-a181-e7f2367cd489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:16.704720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16f952-0843-4742-a181-e7f2367cd489 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:16.758269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 730/1460] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:16.758790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16f952-0843-4742-a181-e7f2367cd489 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:16.774762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9b9f5-16a0-47d6-b8da-a7fe219cebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:16.780588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b9f5-16a0-47d6-b8da-a7fe219cebb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:16.780949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b9f5-16a0-47d6-b8da-a7fe219cebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:16.784164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b9f5-16a0-47d6-b8da-a7fe219cebb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:16.785613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9b9f5-16a0-47d6-b8da-a7fe219cebb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:16.792062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9b9f5-16a0-47d6-b8da-a7fe219cebb5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:16.801899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16f952-0843-4742-a181-e7f2367cd489 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:16.818490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89f8fb-693e-44e0-84b5-70330de90bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:16.819145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89f8fb-693e-44e0-84b5-70330de90bed admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:16.819475 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89f8fb-693e-44e0-84b5-70330de90bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:16.819792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89f8fb-693e-44e0-84b5-70330de90bed admin admin] PATH_INFO: `/v3/projects/66d6f2d390d147ae9adbecf71bead6d7/users/c397f1ea480c4116afdb02af0224ca19/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:16.854663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 731/1461] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:16 2022] POST /identity/v3/users => generated 288 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:16.863505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9b9f5-16a0-47d6-b8da-a7fe219cebb5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:16.887003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89f8fb-693e-44e0-84b5-70330de90bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d6f2d390d147ae9adbecf71bead6d7, user_id=c397f1ea480c4116afdb02af0224ca19, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:16.893742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89f8fb-693e-44e0-84b5-70330de90bed admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:16.896873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9b9f5-16a0-47d6-b8da-a7fe219cebb5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:16.913382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e21e6-5b90-4560-8786-e8f1298238d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:16.914082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e21e6-5b90-4560-8786-e8f1298238d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:16.914370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e21e6-5b90-4560-8786-e8f1298238d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:16.914648 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e21e6-5b90-4560-8786-e8f1298238d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:16.915444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e21e6-5b90-4560-8786-e8f1298238d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:16.917057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e21e6-5b90-4560-8786-e8f1298238d3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:16.936357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 731/1462] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:16 2022] PUT /identity/v3/projects/66d6f2d390d147ae9adbecf71bead6d7/users/c397f1ea480c4116afdb02af0224ca19/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:16.940384 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89f8fb-693e-44e0-84b5-70330de90bed admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:16.946058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 732/1463] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:16.954733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e21e6-5b90-4560-8786-e8f1298238d3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:16.965653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e21e6-5b90-4560-8786-e8f1298238d3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:16.992649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:17.097840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89f8fb-693e-44e0-84b5-70330de90bed admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:17.107141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa5db9-1efa-4e44-ba46-59d15c62bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:17.107945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf34cb-9ef9-45af-910e-18bf812b2178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:17.108575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf34cb-9ef9-45af-910e-18bf812b2178 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:17.108858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf34cb-9ef9-45af-910e-18bf812b2178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:17.109127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf34cb-9ef9-45af-910e-18bf812b2178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:17.110132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa5db9-1efa-4e44-ba46-59d15c62bb19 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:17.110754 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa5db9-1efa-4e44-ba46-59d15c62bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:17.111258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa5db9-1efa-4e44-ba46-59d15c62bb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:17.112160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf34cb-9ef9-45af-910e-18bf812b2178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:17.113024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa5db9-1efa-4e44-ba46-59d15c62bb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:17.114943 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf34cb-9ef9-45af-910e-18bf812b2178 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:17.116940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa5db9-1efa-4e44-ba46-59d15c62bb19 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:17.140917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 732/1464] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:17.147734 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 733/1465] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:17.149195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa5db9-1efa-4e44-ba46-59d15c62bb19 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:17.149750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf34cb-9ef9-45af-910e-18bf812b2178 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:17.166449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:17.177457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf34cb-9ef9-45af-910e-18bf812b2178 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:17.178887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa5db9-1efa-4e44-ba46-59d15c62bb19 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:17.189775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c33c72-7c7b-47bb-93c7-471b674e9a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:17.190499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c33c72-7c7b-47bb-93c7-471b674e9a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:17.190871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c33c72-7c7b-47bb-93c7-471b674e9a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:17.191066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c33c72-7c7b-47bb-93c7-471b674e9a1d admin admin] PATH_INFO: `/v3/projects/66d6f2d390d147ae9adbecf71bead6d7/users/c397f1ea480c4116afdb02af0224ca19/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:17.192628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b5de6-acd7-4000-990c-ca1fa9fd2502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:17.193331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b5de6-acd7-4000-990c-ca1fa9fd2502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:17.193633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b5de6-acd7-4000-990c-ca1fa9fd2502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:17.194078 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b5de6-acd7-4000-990c-ca1fa9fd2502 admin admin] PATH_INFO: `/v3/projects/9ca24c8d99aa4edea056de8d07c84ff9/users/480ba4ceaf8842b8ac07bf3fd3456fe1/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:17.197857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c33c72-7c7b-47bb-93c7-471b674e9a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d6f2d390d147ae9adbecf71bead6d7, user_id=c397f1ea480c4116afdb02af0224ca19, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:17.208561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c33c72-7c7b-47bb-93c7-471b674e9a1d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:17.229837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b5de6-acd7-4000-990c-ca1fa9fd2502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca24c8d99aa4edea056de8d07c84ff9, user_id=480ba4ceaf8842b8ac07bf3fd3456fe1, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:17.231872 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 733/1466] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:17 2022] PUT /identity/v3/projects/66d6f2d390d147ae9adbecf71bead6d7/users/c397f1ea480c4116afdb02af0224ca19/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:17.247438 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3aa96c-9e5c-4726-a9b5-f17a4a2834ed None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:17.247728 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3aa96c-9e5c-4726-a9b5-f17a4a2834ed None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:17.248013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3aa96c-9e5c-4726-a9b5-f17a4a2834ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:17.251159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b5de6-acd7-4000-990c-ca1fa9fd2502 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:17.287896 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 734/1467] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:17 2022] PUT /identity/v3/projects/9ca24c8d99aa4edea056de8d07c84ff9/users/480ba4ceaf8842b8ac07bf3fd3456fe1/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:17.303560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9a1f5-e18e-4b10-a39f-5c5f5b53e183 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:17.303890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9a1f5-e18e-4b10-a39f-5c5f5b53e183 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:17.304119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9a1f5-e18e-4b10-a39f-5c5f5b53e183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:17.334370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4b3aa96c-9e5c-4726-a9b5-f17a4a2834ed None None] MFA Rules not processed for user `c397f1ea480c4116afdb02af0224ca19`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:17.339416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4b3aa96c-9e5c-4726-a9b5-f17a4a2834ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:17.372635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-dab9a1f5-e18e-4b10-a39f-5c5f5b53e183 None None] MFA Rules not processed for user `480ba4ceaf8842b8ac07bf3fd3456fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:17.373858 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dab9a1f5-e18e-4b10-a39f-5c5f5b53e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:17.499077 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 734/1468] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:17.509331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 735/1469] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:17.515231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9a1f5-e18e-4b10-a39f-5c5f5b53e183 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:17.515842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3aa96c-9e5c-4726-a9b5-f17a4a2834ed None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:17.520115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dab9a1f5-e18e-4b10-a39f-5c5f5b53e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:17.661287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3aa96c-9e5c-4726-a9b5-f17a4a2834ed None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:17.678334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06ce16-14d5-4035-a8b6-88a1e305a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:17.680374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06ce16-14d5-4035-a8b6-88a1e305a761 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:17.685111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06ce16-14d5-4035-a8b6-88a1e305a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:17.685288 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06ce16-14d5-4035-a8b6-88a1e305a761 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:17.691500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06ce16-14d5-4035-a8b6-88a1e305a761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:17.692310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9a1f5-e18e-4b10-a39f-5c5f5b53e183 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:17.707161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320fb69-19b9-4a2f-9702-79b16f9d7f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:17.707800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320fb69-19b9-4a2f-9702-79b16f9d7f66 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:17.708082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320fb69-19b9-4a2f-9702-79b16f9d7f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:17.708913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320fb69-19b9-4a2f-9702-79b16f9d7f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:17.715141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06ce16-14d5-4035-a8b6-88a1e305a761 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:17.721646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320fb69-19b9-4a2f-9702-79b16f9d7f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:17.723666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320fb69-19b9-4a2f-9702-79b16f9d7f66 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:17.755308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 736/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:17.811458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 735/1471] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:17 2022] POST /identity/v3/projects => generated 375 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:17.816280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320fb69-19b9-4a2f-9702-79b16f9d7f66 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:17.848729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320fb69-19b9-4a2f-9702-79b16f9d7f66 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:17.918035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:17.931848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06ce16-14d5-4035-a8b6-88a1e305a761 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:18.131491 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06ce16-14d5-4035-a8b6-88a1e305a761 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:18.136084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe8629-17ad-47fb-b8ef-0838eba007c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:18.137067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe8629-17ad-47fb-b8ef-0838eba007c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:18.143600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50511c-4e16-4302-98f3-f8feacd3358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:18.144246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50511c-4e16-4302-98f3-f8feacd3358e admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:18.145226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe8629-17ad-47fb-b8ef-0838eba007c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:18.145680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe8629-17ad-47fb-b8ef-0838eba007c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:18.149637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50511c-4e16-4302-98f3-f8feacd3358e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:18.149637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50511c-4e16-4302-98f3-f8feacd3358e admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:18.149637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50511c-4e16-4302-98f3-f8feacd3358e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:18.151593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50511c-4e16-4302-98f3-f8feacd3358e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:18.206959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:18.214469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 737/1472] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:17 2022] POST /identity/v3/users => generated 288 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:18.221560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50511c-4e16-4302-98f3-f8feacd3358e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:18.244560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50511c-4e16-4302-98f3-f8feacd3358e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:18.268981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e29f-7fe2-470c-a9e9-996f8023865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:18.270502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e29f-7fe2-470c-a9e9-996f8023865f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:18.270502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e29f-7fe2-470c-a9e9-996f8023865f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:18.270502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e29f-7fe2-470c-a9e9-996f8023865f admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:18.270973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628e29f-7fe2-470c-a9e9-996f8023865f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:18.272565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628e29f-7fe2-470c-a9e9-996f8023865f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:18.297425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 738/1473] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:18.307588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e29f-7fe2-470c-a9e9-996f8023865f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:18.314001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe8629-17ad-47fb-b8ef-0838eba007c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:18.318658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe8629-17ad-47fb-b8ef-0838eba007c2 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:18.321346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e29f-7fe2-470c-a9e9-996f8023865f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:18.348424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22205659-7e9f-4498-80e3-8697a5d31c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:18.349060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22205659-7e9f-4498-80e3-8697a5d31c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:18.349343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22205659-7e9f-4498-80e3-8697a5d31c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:18.349617 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22205659-7e9f-4498-80e3-8697a5d31c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:18.350270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22205659-7e9f-4498-80e3-8697a5d31c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:18.350959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 736/1474] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:18.351923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22205659-7e9f-4498-80e3-8697a5d31c51 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:18.380253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 739/1475] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:18.381218 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe8629-17ad-47fb-b8ef-0838eba007c2 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:18.398471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe8629-17ad-47fb-b8ef-0838eba007c2 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:18.416033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e519ac7-691a-4671-b18d-5907ed58433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:18.416743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e519ac7-691a-4671-b18d-5907ed58433c admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:18.417029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e519ac7-691a-4671-b18d-5907ed58433c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:18.417316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e519ac7-691a-4671-b18d-5907ed58433c admin admin] PATH_INFO: `/v3/projects/4537f88cdb1d4f5c9fbe4bd88a5e8dce/users/0186e59106fe4120a5ac1f38b082010a/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:18.454836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e519ac7-691a-4671-b18d-5907ed58433c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4537f88cdb1d4f5c9fbe4bd88a5e8dce, user_id=0186e59106fe4120a5ac1f38b082010a, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:18.462030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e519ac7-691a-4671-b18d-5907ed58433c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:18.510246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 737/1476] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:18 2022] PUT /identity/v3/projects/4537f88cdb1d4f5c9fbe4bd88a5e8dce/users/0186e59106fe4120a5ac1f38b082010a/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:18.511916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bbd21-e383-4928-a6f7-5c6aa979eb85 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:18.512171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bbd21-e383-4928-a6f7-5c6aa979eb85 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:18.512486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bbd21-e383-4928-a6f7-5c6aa979eb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:18.621140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6e7bbd21-e383-4928-a6f7-5c6aa979eb85 None None] MFA Rules not processed for user `0186e59106fe4120a5ac1f38b082010a`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:18.622401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6e7bbd21-e383-4928-a6f7-5c6aa979eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:18.870602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 740/1477] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:18.875646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e519ac7-691a-4671-b18d-5907ed58433c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:19.082417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e519ac7-691a-4671-b18d-5907ed58433c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:19.089481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f8f2d-8bc3-44c6-a616-ae8a9fd5b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:19.090354 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f8f2d-8bc3-44c6-a616-ae8a9fd5b4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:19.091143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f8f2d-8bc3-44c6-a616-ae8a9fd5b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:19.091604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f8f2d-8bc3-44c6-a616-ae8a9fd5b4c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:19.103199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f8f2d-8bc3-44c6-a616-ae8a9fd5b4c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:19.105357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f8f2d-8bc3-44c6-a616-ae8a9fd5b4c9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:19.167304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 738/1478] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:18 2022] POST /identity/v3/projects => generated 375 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:19.172484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bbd21-e383-4928-a6f7-5c6aa979eb85 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:19.195482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bbd21-e383-4928-a6f7-5c6aa979eb85 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:19.362233 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437af10-ae53-4b17-bca2-9166c575f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:19.362851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437af10-ae53-4b17-bca2-9166c575f5dd admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:19.362851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437af10-ae53-4b17-bca2-9166c575f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:19.363241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437af10-ae53-4b17-bca2-9166c575f5dd admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:19.363910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437af10-ae53-4b17-bca2-9166c575f5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:19.368475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437af10-ae53-4b17-bca2-9166c575f5dd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:19.455424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 741/1479] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:19 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:19.460371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f8f2d-8bc3-44c6-a616-ae8a9fd5b4c9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:19.465289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437af10-ae53-4b17-bca2-9166c575f5dd admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:19.470331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0437af10-ae53-4b17-bca2-9166c575f5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:19.484934 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f8f2d-8bc3-44c6-a616-ae8a9fd5b4c9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:19.513390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831fde2-cbca-45e6-bd6d-816c32d1dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:19.513945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831fde2-cbca-45e6-bd6d-816c32d1dd08 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:19.514226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831fde2-cbca-45e6-bd6d-816c32d1dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:19.514505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831fde2-cbca-45e6-bd6d-816c32d1dd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:19.515523 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831fde2-cbca-45e6-bd6d-816c32d1dd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:19.525310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831fde2-cbca-45e6-bd6d-816c32d1dd08 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:19.531820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437af10-ae53-4b17-bca2-9166c575f5dd admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:19.543064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:19.544173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:19.544941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:19.545987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] PATH_INFO: `/v3/users/d4abc4125c9049ce84f8dd5a245367e3` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:19.547691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4abc4125c9049ce84f8dd5a245367e3)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:19.550851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:19.554183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:19.575037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 739/1480] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:19.585150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831fde2-cbca-45e6-bd6d-816c32d1dd08 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:19.645328 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831fde2-cbca-45e6-bd6d-816c32d1dd08 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:19.714278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea91c2-bbda-4e5a-81c0-47af94c56ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:19.715222 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea91c2-bbda-4e5a-81c0-47af94c56ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:19.721330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea91c2-bbda-4e5a-81c0-47af94c56ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:19.724030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea91c2-bbda-4e5a-81c0-47af94c56ee3 admin admin] PATH_INFO: `/v3/projects/dbbd07d7782a400d9363715ea4f72fd9/users/334649b307f94cdb8096f2b52343bd01/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:19.779153 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4abc4125c9049ce84f8dd5a245367e3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:19.781274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4abc4125c9049ce84f8dd5a245367e3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:19.822335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4abc4125c9049ce84f8dd5a245367e3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:19.842659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea91c2-bbda-4e5a-81c0-47af94c56ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbd07d7782a400d9363715ea4f72fd9, user_id=334649b307f94cdb8096f2b52343bd01, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:19.857291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea91c2-bbda-4e5a-81c0-47af94c56ee3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:19.889998 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4abc4125c9049ce84f8dd5a245367e3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:19.893475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-752a0dc6-82fe-446e-a260-bd68d4fdc65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4abc4125c9049ce84f8dd5a245367e3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:19.938052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 740/1481] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:19 2022] PUT /identity/v3/projects/dbbd07d7782a400d9363715ea4f72fd9/users/334649b307f94cdb8096f2b52343bd01/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:19.940714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea91c2-bbda-4e5a-81c0-47af94c56ee3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:19.948663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cfea91c2-bbda-4e5a-81c0-47af94c56ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:19.998866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 742/1482] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:19 2022] DELETE /identity/v3/users/d4abc4125c9049ce84f8dd5a245367e3 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:20.005246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b53099-b490-481e-ac71-a1b1ad474c65 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:20.006825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b53099-b490-481e-ac71-a1b1ad474c65 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:20.008690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b53099-b490-481e-ac71-a1b1ad474c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:20.096520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-16b53099-b490-481e-ac71-a1b1ad474c65 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:20.099678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:20.100900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-16b53099-b490-481e-ac71-a1b1ad474c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:20.230098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea91c2-bbda-4e5a-81c0-47af94c56ee3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:20.272777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 743/1483] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:20.326237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b53099-b490-481e-ac71-a1b1ad474c65 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:20.328126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-16b53099-b490-481e-ac71-a1b1ad474c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:20.451382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d958-f5be-412b-ab7d-cb5084f855f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:20.452160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d958-f5be-412b-ab7d-cb5084f855f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:20.462679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d958-f5be-412b-ab7d-cb5084f855f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:20.465190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d958-f5be-412b-ab7d-cb5084f855f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:20.466049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415d958-f5be-412b-ab7d-cb5084f855f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:20.473359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415d958-f5be-412b-ab7d-cb5084f855f6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:20.529662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 741/1484] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 591 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:20.537547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d958-f5be-412b-ab7d-cb5084f855f6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:20.546808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a415d958-f5be-412b-ab7d-cb5084f855f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:20.560933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b53099-b490-481e-ac71-a1b1ad474c65 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:20.571425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790f026-43de-4162-a3e6-1f388c783d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:20.574918 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f026-43de-4162-a3e6-1f388c783d70 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:20.575221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f026-43de-4162-a3e6-1f388c783d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:20.575763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f026-43de-4162-a3e6-1f388c783d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:20.606915 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d958-f5be-412b-ab7d-cb5084f855f6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:20.622096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790f026-43de-4162-a3e6-1f388c783d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:20.628397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790f026-43de-4162-a3e6-1f388c783d70 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:20.630026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:20.630693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:20.631042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:20.631592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] PATH_INFO: `/v3/projects/98448d1e5d894d28894b6de8b6f82961` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:20.632644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=98448d1e5d894d28894b6de8b6f82961)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:20.634717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:20.670512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 744/1485] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:20.671833 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790f026-43de-4162-a3e6-1f388c783d70 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:20.698469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790f026-43de-4162-a3e6-1f388c783d70 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:20.728224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc3a3-43bb-45f7-bb9f-17312dd02aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:20.729468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc3a3-43bb-45f7-bb9f-17312dd02aec admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:20.730152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc3a3-43bb-45f7-bb9f-17312dd02aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:20.730722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc3a3-43bb-45f7-bb9f-17312dd02aec admin admin] PATH_INFO: `/v3/projects/dbbd07d7782a400d9363715ea4f72fd9/users/334649b307f94cdb8096f2b52343bd01/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:20.736030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebc3a3-43bb-45f7-bb9f-17312dd02aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbd07d7782a400d9363715ea4f72fd9, user_id=334649b307f94cdb8096f2b52343bd01, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:20.741276 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebc3a3-43bb-45f7-bb9f-17312dd02aec admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:20.781148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 745/1486] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:20 2022] PUT /identity/v3/projects/dbbd07d7782a400d9363715ea4f72fd9/users/334649b307f94cdb8096f2b52343bd01/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:20.786169 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2731-281e-49d1-8cbc-692720eb4887 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:20.787569 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2731-281e-49d1-8cbc-692720eb4887 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:20.800372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2731-281e-49d1-8cbc-692720eb4887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:20.811144 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98448d1e5d894d28894b6de8b6f82961', 'request_id': 'req-56b2a356-1576-42ed-915a-1c9194d36bdf'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:20.829021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98448d1e5d894d28894b6de8b6f82961', 'request_id': 'req-56b2a356-1576-42ed-915a-1c9194d36bdf'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:20.838032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98448d1e5d894d28894b6de8b6f82961', 'request_id': 'req-56b2a356-1576-42ed-915a-1c9194d36bdf'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:20.853481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:20.866842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] The token cache is being invalidate because project 98448d1e5d894d28894b6de8b6f82961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:20.868849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:20.870644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:20.873044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-da7f2731-281e-49d1-8cbc-692720eb4887 None None] MFA Rules not processed for user `334649b307f94cdb8096f2b52343bd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:20.878560 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 742/1487] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:20 2022] DELETE /identity/v3/projects/98448d1e5d894d28894b6de8b6f82961 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:20.880805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-da7f2731-281e-49d1-8cbc-692720eb4887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:20.881627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:20.885320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:21.085761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2a356-1576-42ed-915a-1c9194d36bdf admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:21.136673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:21.145748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 746/1488] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:21.158709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f2731-281e-49d1-8cbc-692720eb4887 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:21.160781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-da7f2731-281e-49d1-8cbc-692720eb4887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:21.276596 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:21.277257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:21.277536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:21.277811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] PATH_INFO: `/v3/users/8b93b40d818b4407a60846730b1387de` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:21.282783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b93b40d818b4407a60846730b1387de)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:21.288347 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:21.386810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f2731-281e-49d1-8cbc-692720eb4887 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:21.402281 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece54bd-c241-4414-8d1e-7f0b6916aabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:21.403094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece54bd-c241-4414-8d1e-7f0b6916aabd service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:21.403533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece54bd-c241-4414-8d1e-7f0b6916aabd service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:21.403894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece54bd-c241-4414-8d1e-7f0b6916aabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:21.405844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1ece54bd-c241-4414-8d1e-7f0b6916aabd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:21.420592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b93b40d818b4407a60846730b1387de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:21.446779 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b93b40d818b4407a60846730b1387de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:21.461498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b93b40d818b4407a60846730b1387de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:21.493245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b93b40d818b4407a60846730b1387de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:21.493855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a940b093-cf7d-45f3-b53c-332dbc3e492f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b93b40d818b4407a60846730b1387de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:21.506099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 743/1489] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:20 2022] DELETE /identity/v3/users/8b93b40d818b4407a60846730b1387de => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:21.581608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece54bd-c241-4414-8d1e-7f0b6916aabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:21.585254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece54bd-c241-4414-8d1e-7f0b6916aabd service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:21.612997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 747/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:22.339994 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06c57f-28f2-4031-a295-ce2b7309005c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:22.340556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06c57f-28f2-4031-a295-ce2b7309005c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:22.340556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06c57f-28f2-4031-a295-ce2b7309005c None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:22.342303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 744/1491] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:21:22.373598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3adb8-a2f2-4983-85e8-60d91cc2fc69 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:22.373598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3adb8-a2f2-4983-85e8-60d91cc2fc69 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:22.373598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3adb8-a2f2-4983-85e8-60d91cc2fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:22.423669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5ab3adb8-a2f2-4983-85e8-60d91cc2fc69 None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:22.424898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5ab3adb8-a2f2-4983-85e8-60d91cc2fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:22.584474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:22.677189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 748/1492] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:22.739120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06c57f-28f2-4031-a295-ce2b7309005c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:22.748664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bc06c57f-28f2-4031-a295-ce2b7309005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:22.801975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06c57f-28f2-4031-a295-ce2b7309005c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:22.810712 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f572ac-3696-48e0-a0ba-68c9a942fca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:22.811873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f572ac-3696-48e0-a0ba-68c9a942fca2 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:22.812553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f572ac-3696-48e0-a0ba-68c9a942fca2 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:22.812981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f572ac-3696-48e0-a0ba-68c9a942fca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:22.832488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f572ac-3696-48e0-a0ba-68c9a942fca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:22.849977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f572ac-3696-48e0-a0ba-68c9a942fca2 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:22.880003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 745/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:24.608962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3adb8-a2f2-4983-85e8-60d91cc2fc69 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:24.612300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5ab3adb8-a2f2-4983-85e8-60d91cc2fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:24.804600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3adb8-a2f2-4983-85e8-60d91cc2fc69 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:24.809342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105384cf-1c8d-435a-b7e8-dbc559e50449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:24.810228 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105384cf-1c8d-435a-b7e8-dbc559e50449 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:24.810667 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105384cf-1c8d-435a-b7e8-dbc559e50449 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:24.811174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105384cf-1c8d-435a-b7e8-dbc559e50449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:24.813570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-105384cf-1c8d-435a-b7e8-dbc559e50449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:25.019114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105384cf-1c8d-435a-b7e8-dbc559e50449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:25.021029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105384cf-1c8d-435a-b7e8-dbc559e50449 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:25.033331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 749/1494] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:25.372143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f572ac-3696-48e0-a0ba-68c9a942fca2 service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:25.374249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-23f572ac-3696-48e0-a0ba-68c9a942fca2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:25.514940 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f572ac-3696-48e0-a0ba-68c9a942fca2 service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:25.528435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:25.532498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:25.533690 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:25.534023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] PATH_INFO: `/v3/projects/1792969943a5406389bc02e7f3733731` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:25.537216 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1792969943a5406389bc02e7f3733731)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:25.541285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:25.616258 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:25.666687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1792969943a5406389bc02e7f3733731', 'request_id': 'req-04d4afce-d28b-4429-9ff1-43008d508a8a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:25.683543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1792969943a5406389bc02e7f3733731', 'request_id': 'req-04d4afce-d28b-4429-9ff1-43008d508a8a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:25.697220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1792969943a5406389bc02e7f3733731', 'request_id': 'req-04d4afce-d28b-4429-9ff1-43008d508a8a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:25.735428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] The token cache is being invalidate because project 1792969943a5406389bc02e7f3733731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:25.737876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:25.740178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-04d4afce-d28b-4429-9ff1-43008d508a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:25.748774 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 746/1495] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:25 2022] DELETE /identity/v3/projects/1792969943a5406389bc02e7f3733731 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:25.753137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105384cf-1c8d-435a-b7e8-dbc559e50449 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:25.784146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105384cf-1c8d-435a-b7e8-dbc559e50449 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:25.968189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:25.968912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:25.969124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:25.974004 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] PATH_INFO: `/v3/users/fa08ab018db04b9f97d8d980fb954b29` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:25.979377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa08ab018db04b9f97d8d980fb954b29)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:25.983951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:26.089919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:26.108575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa08ab018db04b9f97d8d980fb954b29'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:26.113148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa08ab018db04b9f97d8d980fb954b29'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:26.129941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa08ab018db04b9f97d8d980fb954b29'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:26.168777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa08ab018db04b9f97d8d980fb954b29'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:26.172103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9a4390ee-0c49-4827-97db-3d0aab83cf81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa08ab018db04b9f97d8d980fb954b29'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:26.245291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 750/1496] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:25 2022] DELETE /identity/v3/users/fa08ab018db04b9f97d8d980fb954b29 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:26.286772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff0e0-9ec3-436e-9feb-39cf305f81ee None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:26.287111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff0e0-9ec3-436e-9feb-39cf305f81ee None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:26.287470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff0e0-9ec3-436e-9feb-39cf305f81ee None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:26.289915 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 747/1497] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:21:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:21:26.368807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da5ab-6fe9-4a6b-bbb0-1e3d49e1eda9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:26.369516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da5ab-6fe9-4a6b-bbb0-1e3d49e1eda9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:26.370077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da5ab-6fe9-4a6b-bbb0-1e3d49e1eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:26.413645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ba9da5ab-6fe9-4a6b-bbb0-1e3d49e1eda9 None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:26.415115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ba9da5ab-6fe9-4a6b-bbb0-1e3d49e1eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:26.596911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 751/1498] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:21:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:26.725813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ff0e0-9ec3-436e-9feb-39cf305f81ee None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:26.728182 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-da5ff0e0-9ec3-436e-9feb-39cf305f81ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:26.830200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9da5ab-6fe9-4a6b-bbb0-1e3d49e1eda9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:26.834646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ba9da5ab-6fe9-4a6b-bbb0-1e3d49e1eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:26.873798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ff0e0-9ec3-436e-9feb-39cf305f81ee None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:26.888195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa02a6-6b71-4223-81d5-4ecd2237d2e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:26.892618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa02a6-6b71-4223-81d5-4ecd2237d2e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:26.893260 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa02a6-6b71-4223-81d5-4ecd2237d2e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:26.893719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa02a6-6b71-4223-81d5-4ecd2237d2e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:26.897376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7faa02a6-6b71-4223-81d5-4ecd2237d2e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:27.051056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9da5ab-6fe9-4a6b-bbb0-1e3d49e1eda9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:27.075456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:27.077723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.079066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.079482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] PATH_INFO: `/v3/projects/ecc6a17394a1493c97449e800903aa30` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.088753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc6a17394a1493c97449e800903aa30)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:27.090884 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:27.124051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa02a6-6b71-4223-81d5-4ecd2237d2e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:27.129019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa02a6-6b71-4223-81d5-4ecd2237d2e1 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:27.147211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 748/1499] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:27.179417 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc6a17394a1493c97449e800903aa30', 'request_id': 'req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:27.180891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:27.187687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc6a17394a1493c97449e800903aa30', 'request_id': 'req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:27.198943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc6a17394a1493c97449e800903aa30', 'request_id': 'req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:27.217932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] The token cache is being invalidate because project ecc6a17394a1493c97449e800903aa30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:27.218477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:27.219437 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-740e6bfe-8e66-4bb4-9fcf-7cfb5ef4e96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:27.227307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb79fd-dd46-4cbd-91a3-3770c39d08b6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.227685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb79fd-dd46-4cbd-91a3-3770c39d08b6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.228027 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb79fd-dd46-4cbd-91a3-3770c39d08b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.231361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 752/1500] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:26 2022] DELETE /identity/v3/projects/ecc6a17394a1493c97449e800903aa30 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:27.259800 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f3bb79fd-dd46-4cbd-91a3-3770c39d08b6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:27.261177 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f3bb79fd-dd46-4cbd-91a3-3770c39d08b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:27.353079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 749/1501] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:27.359864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1c3c3-4e13-45aa-b252-7c37f9b3ac75 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.360223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1c3c3-4e13-45aa-b252-7c37f9b3ac75 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.360586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1c3c3-4e13-45aa-b252-7c37f9b3ac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.385021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-78b1c3c3-4e13-45aa-b252-7c37f9b3ac75 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:27.386329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-78b1c3c3-4e13-45aa-b252-7c37f9b3ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:27.399199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 753/1502] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:27.405124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb79fd-dd46-4cbd-91a3-3770c39d08b6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:27.411736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:27.416378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1c3c3-4e13-45aa-b252-7c37f9b3ac75 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:27.419330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-78b1c3c3-4e13-45aa-b252-7c37f9b3ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:27.422822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb79fd-dd46-4cbd-91a3-3770c39d08b6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:27.431832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ddc37-d693-4753-996d-c8d2b73316b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:27.432476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddc37-d693-4753-996d-c8d2b73316b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.432742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddc37-d693-4753-996d-c8d2b73316b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.433019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddc37-d693-4753-996d-c8d2b73316b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.433730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ddc37-d693-4753-996d-c8d2b73316b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:27.434041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ddc37-d693-4753-996d-c8d2b73316b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:27.436504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ddc37-d693-4753-996d-c8d2b73316b6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:27.458531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 750/1503] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:27.463019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ddc37-d693-4753-996d-c8d2b73316b6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:27.478793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ddc37-d693-4753-996d-c8d2b73316b6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:27.483199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4ee30-28fe-465e-a8fb-0aaf83176557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:27.483788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4ee30-28fe-465e-a8fb-0aaf83176557 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.484069 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4ee30-28fe-465e-a8fb-0aaf83176557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.484349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4ee30-28fe-465e-a8fb-0aaf83176557 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.484998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4ee30-28fe-465e-a8fb-0aaf83176557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:27.487006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4ee30-28fe-465e-a8fb-0aaf83176557 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:27.531748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 751/1504] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:27 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:21:27.533162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4ee30-28fe-465e-a8fb-0aaf83176557 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:27.543332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1c3c3-4e13-45aa-b252-7c37f9b3ac75 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:27.623833 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64827a-6846-4c53-9a37-7edea5f66a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:27.624612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64827a-6846-4c53-9a37-7edea5f66a76 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.624959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64827a-6846-4c53-9a37-7edea5f66a76 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.625299 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64827a-6846-4c53-9a37-7edea5f66a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.627759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bf64827a-6846-4c53-9a37-7edea5f66a76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:27.633083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4ee30-28fe-465e-a8fb-0aaf83176557 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:27.639894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64827a-6846-4c53-9a37-7edea5f66a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:27.640469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151a42c-a4a1-42a2-9a1d-0e800d7de502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:27.641100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151a42c-a4a1-42a2-9a1d-0e800d7de502 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.641375 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151a42c-a4a1-42a2-9a1d-0e800d7de502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.641698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151a42c-a4a1-42a2-9a1d-0e800d7de502 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.641790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64827a-6846-4c53-9a37-7edea5f66a76 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:27.642701 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151a42c-a4a1-42a2-9a1d-0e800d7de502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:27.644965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151a42c-a4a1-42a2-9a1d-0e800d7de502 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:27.653720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 754/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:27.681667 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 752/1506] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:27 2022] POST /identity/v3/users => generated 284 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:27.683997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64827a-6846-4c53-9a37-7edea5f66a76 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:27.739429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64827a-6846-4c53-9a37-7edea5f66a76 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:27.746474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61160971-59a0-464e-98aa-de430c13e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:27.747063 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61160971-59a0-464e-98aa-de430c13e2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.747373 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61160971-59a0-464e-98aa-de430c13e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.747646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61160971-59a0-464e-98aa-de430c13e2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.749425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61160971-59a0-464e-98aa-de430c13e2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:27.751560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61160971-59a0-464e-98aa-de430c13e2a2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:27.766145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 755/1507] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:27.770360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151a42c-a4a1-42a2-9a1d-0e800d7de502 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:27.809135 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151a42c-a4a1-42a2-9a1d-0e800d7de502 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:27.817763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f99ad-b8bd-4fe6-a135-ff2efb8b735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:27.818536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f99ad-b8bd-4fe6-a135-ff2efb8b735f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.818885 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f99ad-b8bd-4fe6-a135-ff2efb8b735f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.819417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f99ad-b8bd-4fe6-a135-ff2efb8b735f admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.821095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f99ad-b8bd-4fe6-a135-ff2efb8b735f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:27.822838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f99ad-b8bd-4fe6-a135-ff2efb8b735f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:27.839948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 753/1508] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:27.841219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61160971-59a0-464e-98aa-de430c13e2a2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:27.854160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61160971-59a0-464e-98aa-de430c13e2a2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:27.859481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da30b2a-2084-48b8-99c3-aedba1e1fbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:27.860155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30b2a-2084-48b8-99c3-aedba1e1fbf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.860950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30b2a-2084-48b8-99c3-aedba1e1fbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.861368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30b2a-2084-48b8-99c3-aedba1e1fbf5 admin admin] PATH_INFO: `/v3/projects/849b86031b4d4555a0f5708efad1dc68/users/1217f10d425641cbb12b0289fd599ab9/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.881221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da30b2a-2084-48b8-99c3-aedba1e1fbf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849b86031b4d4555a0f5708efad1dc68, user_id=1217f10d425641cbb12b0289fd599ab9, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:27.889749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da30b2a-2084-48b8-99c3-aedba1e1fbf5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:27.920689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 756/1509] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:27 2022] PUT /identity/v3/projects/849b86031b4d4555a0f5708efad1dc68/users/1217f10d425641cbb12b0289fd599ab9/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:27.930295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f99ad-b8bd-4fe6-a135-ff2efb8b735f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:27.934415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dc6e8-b6bb-4099-a770-2517c0dcd3a3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:27.935067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dc6e8-b6bb-4099-a770-2517c0dcd3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:27.935735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dc6e8-b6bb-4099-a770-2517c0dcd3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:27.937805 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8b8f99ad-b8bd-4fe6-a135-ff2efb8b735f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:27.980101 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f99ad-b8bd-4fe6-a135-ff2efb8b735f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:28.003149 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-531dc6e8-b6bb-4099-a770-2517c0dcd3a3 None None] MFA Rules not processed for user `1217f10d425641cbb12b0289fd599ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:28.005081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-531dc6e8-b6bb-4099-a770-2517c0dcd3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:28.018585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:28.070848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:28.072368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.072905 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.073920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] PATH_INFO: `/v3/projects/f785207da0594d9ea178c496fec6c2af` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.076748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f785207da0594d9ea178c496fec6c2af)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:28.082656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:28.101164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 757/1510] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:28.105996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dc6e8-b6bb-4099-a770-2517c0dcd3a3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:28.122483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dc6e8-b6bb-4099-a770-2517c0dcd3a3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:28.137549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0d784-600f-41e5-b26c-0e01e23d5be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:28.138390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0d784-600f-41e5-b26c-0e01e23d5be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.138856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0d784-600f-41e5-b26c-0e01e23d5be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.139403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0d784-600f-41e5-b26c-0e01e23d5be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.140227 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0d784-600f-41e5-b26c-0e01e23d5be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:28.143018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0d784-600f-41e5-b26c-0e01e23d5be0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:28.164910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:28.166725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f785207da0594d9ea178c496fec6c2af', 'request_id': 'req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:28.183163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f785207da0594d9ea178c496fec6c2af', 'request_id': 'req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:28.195772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f785207da0594d9ea178c496fec6c2af', 'request_id': 'req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:28.227424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] The token cache is being invalidate because project f785207da0594d9ea178c496fec6c2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:28.227664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:28.228814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 758/1511] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:28 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:28.231393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7057ea1c-8f78-4e7e-bafc-41b3241bd98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:28.232506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0d784-600f-41e5-b26c-0e01e23d5be0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:28.235727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-29e0d784-600f-41e5-b26c-0e01e23d5be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:28.237476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 754/1512] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:27 2022] DELETE /identity/v3/projects/f785207da0594d9ea178c496fec6c2af => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:28.242869 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351c6fa-45b0-4218-a0c9-3a278a0ec015 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.243393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351c6fa-45b0-4218-a0c9-3a278a0ec015 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.243507 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351c6fa-45b0-4218-a0c9-3a278a0ec015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.289836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e351c6fa-45b0-4218-a0c9-3a278a0ec015 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:28.289836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e351c6fa-45b0-4218-a0c9-3a278a0ec015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:28.391528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0d784-600f-41e5-b26c-0e01e23d5be0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:28.398186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fde84-5006-4ca9-8731-eaded4e63efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:28.399008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fde84-5006-4ca9-8731-eaded4e63efc admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.399124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fde84-5006-4ca9-8731-eaded4e63efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.399378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fde84-5006-4ca9-8731-eaded4e63efc admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.400024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fde84-5006-4ca9-8731-eaded4e63efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:28.402328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fde84-5006-4ca9-8731-eaded4e63efc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:28.441563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 755/1513] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:28.449204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247c2a-3c60-4d79-8165-40d74c514374 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.449549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247c2a-3c60-4d79-8165-40d74c514374 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.449843 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247c2a-3c60-4d79-8165-40d74c514374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.453224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 759/1514] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:28 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:28.459098 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fde84-5006-4ca9-8731-eaded4e63efc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:28.481183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fde84-5006-4ca9-8731-eaded4e63efc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:28.490582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ea247c2a-3c60-4d79-8165-40d74c514374 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:28.492068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ea247c2a-3c60-4d79-8165-40d74c514374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:28.497738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f75e1c-0ab7-4d6b-83f1-e8bb0cd43136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:28.498724 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75e1c-0ab7-4d6b-83f1-e8bb0cd43136 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.499009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75e1c-0ab7-4d6b-83f1-e8bb0cd43136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.499292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f75e1c-0ab7-4d6b-83f1-e8bb0cd43136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.500210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f75e1c-0ab7-4d6b-83f1-e8bb0cd43136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:28.503307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 756/1515] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:28.503307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea247c2a-3c60-4d79-8165-40d74c514374 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:28.503516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f75e1c-0ab7-4d6b-83f1-e8bb0cd43136 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:28.503920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ea247c2a-3c60-4d79-8165-40d74c514374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:28.518984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 760/1516] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:28.519384 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea247c2a-3c60-4d79-8165-40d74c514374 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:28.519466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f75e1c-0ab7-4d6b-83f1-e8bb0cd43136 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:28.525019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:28.525761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.526776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.526776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] PATH_INFO: `/v3/users/d4bb2c68b9c44a15b6b1d5c3cf015482` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.528132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bb2c68b9c44a15b6b1d5c3cf015482)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:28.530524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:28.532805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f75e1c-0ab7-4d6b-83f1-e8bb0cd43136 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:28.540246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d3913-0be5-438d-9357-7f5fcb79c601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:28.541009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d3913-0be5-438d-9357-7f5fcb79c601 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.541529 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d3913-0be5-438d-9357-7f5fcb79c601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.541881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d3913-0be5-438d-9357-7f5fcb79c601 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.543117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d3913-0be5-438d-9357-7f5fcb79c601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:28.543117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d3913-0be5-438d-9357-7f5fcb79c601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:28.544885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d3913-0be5-438d-9357-7f5fcb79c601 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:28.561806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 761/1517] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:28.562513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d3913-0be5-438d-9357-7f5fcb79c601 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:28.575775 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d3913-0be5-438d-9357-7f5fcb79c601 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:28.580658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e30e51-2f86-49a7-9f45-aaf1bb9b23df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:28.581689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30e51-2f86-49a7-9f45-aaf1bb9b23df admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.582069 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30e51-2f86-49a7-9f45-aaf1bb9b23df admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.582964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30e51-2f86-49a7-9f45-aaf1bb9b23df admin admin] PATH_INFO: `/v3/projects/c84438aa99f44ea0b9bc7fdb0beb566c/users/7c314b0c007d4eeba2b2c07ce81f7316/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.608313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bb2c68b9c44a15b6b1d5c3cf015482'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:28.614358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e30e51-2f86-49a7-9f45-aaf1bb9b23df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84438aa99f44ea0b9bc7fdb0beb566c, user_id=7c314b0c007d4eeba2b2c07ce81f7316, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:28.618223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bb2c68b9c44a15b6b1d5c3cf015482'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:28.619634 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e30e51-2f86-49a7-9f45-aaf1bb9b23df admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:28.631942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bb2c68b9c44a15b6b1d5c3cf015482'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:28.643370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 762/1518] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:28 2022] PUT /identity/v3/projects/c84438aa99f44ea0b9bc7fdb0beb566c/users/7c314b0c007d4eeba2b2c07ce81f7316/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:28.648493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e30e51-2f86-49a7-9f45-aaf1bb9b23df admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:28.657404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bb2c68b9c44a15b6b1d5c3cf015482'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:28.659558 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bb2c68b9c44a15b6b1d5c3cf015482'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:28.672356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 757/1519] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:28 2022] DELETE /identity/v3/users/d4bb2c68b9c44a15b6b1d5c3cf015482 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:28.673217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:28.676571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:28.699696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:28.757212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e30e51-2f86-49a7-9f45-aaf1bb9b23df admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:28.775876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:28.835237 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeda74-4b9e-4919-8702-67aa5704c23b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:28.850247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bf9f8-a23a-4849-82b2-2efbe7d375bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:28.851101 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bf9f8-a23a-4849-82b2-2efbe7d375bc admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.851610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bf9f8-a23a-4849-82b2-2efbe7d375bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.853171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bf9f8-a23a-4849-82b2-2efbe7d375bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.855122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bf9f8-a23a-4849-82b2-2efbe7d375bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:28.855403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7872-129b-4f70-a50f-c44b602a1558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:28.856999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7872-129b-4f70-a50f-c44b602a1558 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.858154 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7872-129b-4f70-a50f-c44b602a1558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.858448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7872-129b-4f70-a50f-c44b602a1558 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.859101 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bf9f8-a23a-4849-82b2-2efbe7d375bc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:28.859186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc7872-129b-4f70-a50f-c44b602a1558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:28.861622 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc7872-129b-4f70-a50f-c44b602a1558 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:28.881769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 758/1520] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:28.889113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b46b2-7217-40c9-97f2-ffe17d1aa1f5 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:28.889543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b46b2-7217-40c9-97f2-ffe17d1aa1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:28.889897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b46b2-7217-40c9-97f2-ffe17d1aa1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:28.899561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 763/1521] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:28 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:28.904050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7872-129b-4f70-a50f-c44b602a1558 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:28.926749 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ce9b46b2-7217-40c9-97f2-ffe17d1aa1f5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:28.928182 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ce9b46b2-7217-40c9-97f2-ffe17d1aa1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:29.000222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7872-129b-4f70-a50f-c44b602a1558 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.000807 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 759/1522] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:29.002460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b46b2-7217-40c9-97f2-ffe17d1aa1f5 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.004244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ce9b46b2-7217-40c9-97f2-ffe17d1aa1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:29.006512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dd2f8-791e-44f4-a967-fd5fb8d18dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.007442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dd2f8-791e-44f4-a967-fd5fb8d18dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.007900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dd2f8-791e-44f4-a967-fd5fb8d18dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.008384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dd2f8-791e-44f4-a967-fd5fb8d18dd5 admin admin] PATH_INFO: `/v3/projects/c84438aa99f44ea0b9bc7fdb0beb566c/users/7c314b0c007d4eeba2b2c07ce81f7316/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.010761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dd2f8-791e-44f4-a967-fd5fb8d18dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84438aa99f44ea0b9bc7fdb0beb566c, user_id=7c314b0c007d4eeba2b2c07ce81f7316, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:29.014642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dd2f8-791e-44f4-a967-fd5fb8d18dd5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:29.025340 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b46b2-7217-40c9-97f2-ffe17d1aa1f5 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.033441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 764/1523] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:28 2022] PUT /identity/v3/projects/c84438aa99f44ea0b9bc7fdb0beb566c/users/7c314b0c007d4eeba2b2c07ce81f7316/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:29.043056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dd2f8-791e-44f4-a967-fd5fb8d18dd5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.046057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c03dd2f8-791e-44f4-a967-fd5fb8d18dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:29.129136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56882f9-8db9-4a16-ab77-5ee756f6275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.129839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56882f9-8db9-4a16-ab77-5ee756f6275e admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.130927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56882f9-8db9-4a16-ab77-5ee756f6275e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.131456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56882f9-8db9-4a16-ab77-5ee756f6275e admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.132153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56882f9-8db9-4a16-ab77-5ee756f6275e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:29.134981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56882f9-8db9-4a16-ab77-5ee756f6275e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:29.138554 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dd2f8-791e-44f4-a967-fd5fb8d18dd5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.150752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5b754-ab26-4e31-8a8d-d253664d367f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.151522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5b754-ab26-4e31-8a8d-d253664d367f service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.151809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5b754-ab26-4e31-8a8d-d253664d367f service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.152125 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5b754-ab26-4e31-8a8d-d253664d367f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.171984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 760/1524] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:29 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:29.171984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e29e61-1ae4-4453-8418-19446d703d27 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.171984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e29e61-1ae4-4453-8418-19446d703d27 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.171984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e29e61-1ae4-4453-8418-19446d703d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.172386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5b754-ab26-4e31-8a8d-d253664d367f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:29.172386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5b754-ab26-4e31-8a8d-d253664d367f service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:29.175102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:29.185440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 765/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:29.186404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5b754-ab26-4e31-8a8d-d253664d367f service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.199356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5b754-ab26-4e31-8a8d-d253664d367f service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.206378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-66e29e61-1ae4-4453-8418-19446d703d27 None None] MFA Rules not processed for user `7c314b0c007d4eeba2b2c07ce81f7316`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:29.206537 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc02239-3c9e-4768-8107-babd795c457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.207256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc02239-3c9e-4768-8107-babd795c457f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.207599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc02239-3c9e-4768-8107-babd795c457f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.207729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-66e29e61-1ae4-4453-8418-19446d703d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:29.207925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc02239-3c9e-4768-8107-babd795c457f admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.208590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc02239-3c9e-4768-8107-babd795c457f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:29.210973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc02239-3c9e-4768-8107-babd795c457f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:29.225536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 766/1526] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:29.228111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc02239-3c9e-4768-8107-babd795c457f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.241370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc02239-3c9e-4768-8107-babd795c457f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.249347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c90233-19d2-4885-a1ad-37700e11ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.249812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90233-19d2-4885-a1ad-37700e11ed84 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.250160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90233-19d2-4885-a1ad-37700e11ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.250559 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c90233-19d2-4885-a1ad-37700e11ed84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.251151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c90233-19d2-4885-a1ad-37700e11ed84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:29.253993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c90233-19d2-4885-a1ad-37700e11ed84 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:29.269368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 767/1527] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:29.274452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c90233-19d2-4885-a1ad-37700e11ed84 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.303814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c90233-19d2-4885-a1ad-37700e11ed84 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.309882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:29.314861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bcd9f-1cbd-42da-b912-54509dd2ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.316060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bcd9f-1cbd-42da-b912-54509dd2ed87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.316574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bcd9f-1cbd-42da-b912-54509dd2ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.318448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bcd9f-1cbd-42da-b912-54509dd2ed87 admin admin] PATH_INFO: `/v3/projects/d179687d742c45b99b8441ef8382c46a/users/974c645d704f43f39a79d3b46da04dc2/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.335000 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 761/1528] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:29.343379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e29e61-1ae4-4453-8418-19446d703d27 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.345120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-66e29e61-1ae4-4453-8418-19446d703d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:29.363137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bcd9f-1cbd-42da-b912-54509dd2ed87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d179687d742c45b99b8441ef8382c46a, user_id=974c645d704f43f39a79d3b46da04dc2, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:29.366474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bcd9f-1cbd-42da-b912-54509dd2ed87 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:29.386773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 768/1529] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:29 2022] PUT /identity/v3/projects/d179687d742c45b99b8441ef8382c46a/users/974c645d704f43f39a79d3b46da04dc2/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:29.398769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e9631-1747-448f-91d7-ed41c195f3ae None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.399383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e9631-1747-448f-91d7-ed41c195f3ae None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.400290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e9631-1747-448f-91d7-ed41c195f3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.441295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-356e9631-1747-448f-91d7-ed41c195f3ae None None] MFA Rules not processed for user `974c645d704f43f39a79d3b46da04dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:29.442924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-356e9631-1747-448f-91d7-ed41c195f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:29.474426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e29e61-1ae4-4453-8418-19446d703d27 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.565987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e3573-8586-47f4-be16-807bceb5a687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.566699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e3573-8586-47f4-be16-807bceb5a687 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.567107 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e3573-8586-47f4-be16-807bceb5a687 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.567698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e3573-8586-47f4-be16-807bceb5a687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.573619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 769/1530] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:29.580672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e9631-1747-448f-91d7-ed41c195f3ae None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.657983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e9631-1747-448f-91d7-ed41c195f3ae None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.663536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c997f-9d70-4412-9dec-5e3940d195c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.663991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c997f-9d70-4412-9dec-5e3940d195c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.664273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c997f-9d70-4412-9dec-5e3940d195c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.664552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c997f-9d70-4412-9dec-5e3940d195c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.665195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c997f-9d70-4412-9dec-5e3940d195c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:29.667526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c997f-9d70-4412-9dec-5e3940d195c8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:29.670264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e3573-8586-47f4-be16-807bceb5a687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:29.671843 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e3573-8586-47f4-be16-807bceb5a687 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:29.700205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 762/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:29.712475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 770/1532] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:29 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:29.716669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e3573-8586-47f4-be16-807bceb5a687 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.735707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e3573-8586-47f4-be16-807bceb5a687 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.803951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c997f-9d70-4412-9dec-5e3940d195c8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.821452 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce634-340c-43e3-ba16-37acd55638c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.822898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce634-340c-43e3-ba16-37acd55638c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.823360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce634-340c-43e3-ba16-37acd55638c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.823783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce634-340c-43e3-ba16-37acd55638c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.824921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce634-340c-43e3-ba16-37acd55638c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:29.828374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce634-340c-43e3-ba16-37acd55638c8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:29.846600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:29.876954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:29.887668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 763/1533] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:29 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:21:29.890223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce634-340c-43e3-ba16-37acd55638c8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.908527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce634-340c-43e3-ba16-37acd55638c8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.918775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e916f1-e861-4f0a-b31b-36c4de875aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.919607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e916f1-e861-4f0a-b31b-36c4de875aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.920025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e916f1-e861-4f0a-b31b-36c4de875aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.920603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e916f1-e861-4f0a-b31b-36c4de875aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.921979 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e916f1-e861-4f0a-b31b-36c4de875aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:29.924378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e916f1-e861-4f0a-b31b-36c4de875aa5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:29.928239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c997f-9d70-4412-9dec-5e3940d195c8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.942598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 764/1534] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:21:29.944788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e916f1-e861-4f0a-b31b-36c4de875aa5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:29.951382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b02875-df9b-4a7b-bc63-0b58381f599e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.951643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b02875-df9b-4a7b-bc63-0b58381f599e service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.951910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b02875-df9b-4a7b-bc63-0b58381f599e service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.952186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b02875-df9b-4a7b-bc63-0b58381f599e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:29.955534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b5b02875-df9b-4a7b-bc63-0b58381f599e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:29.975742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e916f1-e861-4f0a-b31b-36c4de875aa5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:29.988259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb798a2-40c5-4752-a9a1-ebaf49cb6529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:29.989857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb798a2-40c5-4752-a9a1-ebaf49cb6529 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:29.990160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb798a2-40c5-4752-a9a1-ebaf49cb6529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:29.991183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb798a2-40c5-4752-a9a1-ebaf49cb6529 admin admin] PATH_INFO: `/v3/projects/6e0dd08f115c47548797127b2e416ae5/users/2f9045c9c8cc4e91913fb4bd7a2708f9/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:30.036809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb798a2-40c5-4752-a9a1-ebaf49cb6529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0dd08f115c47548797127b2e416ae5, user_id=2f9045c9c8cc4e91913fb4bd7a2708f9, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:30.039565 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb798a2-40c5-4752-a9a1-ebaf49cb6529 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:30.045777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b02875-df9b-4a7b-bc63-0b58381f599e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:30.047456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b02875-df9b-4a7b-bc63-0b58381f599e service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:30.061849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 765/1535] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:29 2022] PUT /identity/v3/projects/6e0dd08f115c47548797127b2e416ae5/users/2f9045c9c8cc4e91913fb4bd7a2708f9/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:30.062930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb798a2-40c5-4752-a9a1-ebaf49cb6529 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:30.066948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cdb798a2-40c5-4752-a9a1-ebaf49cb6529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:30.073825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 771/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:30.074697 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b02875-df9b-4a7b-bc63-0b58381f599e service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:30.117624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b02875-df9b-4a7b-bc63-0b58381f599e service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:30.226925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb798a2-40c5-4752-a9a1-ebaf49cb6529 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:30.245430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:30.247252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:30.247804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:30.248219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] PATH_INFO: `/v3/projects/7ed39193ba7f4af6903fdcb758010131` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:30.253853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed39193ba7f4af6903fdcb758010131)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:30.256574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:30.260272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45964b69-5bbf-4024-9173-d9885d226b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:30.261478 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45964b69-5bbf-4024-9173-d9885d226b63 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:30.262169 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45964b69-5bbf-4024-9173-d9885d226b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:30.262811 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45964b69-5bbf-4024-9173-d9885d226b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:30.263824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45964b69-5bbf-4024-9173-d9885d226b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:30.266626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45964b69-5bbf-4024-9173-d9885d226b63 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:30.296490 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 772/1537] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:30.301805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45964b69-5bbf-4024-9173-d9885d226b63 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:30.330993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45964b69-5bbf-4024-9173-d9885d226b63 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:30.346964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed39193ba7f4af6903fdcb758010131', 'request_id': 'req-785b1db5-6556-4228-91f7-68b81ce20464'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:30.364557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed39193ba7f4af6903fdcb758010131', 'request_id': 'req-785b1db5-6556-4228-91f7-68b81ce20464'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:30.381614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed39193ba7f4af6903fdcb758010131', 'request_id': 'req-785b1db5-6556-4228-91f7-68b81ce20464'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:30.413015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] The token cache is being invalidate because project 7ed39193ba7f4af6903fdcb758010131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:30.414388 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:30.415357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:30.417791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 766/1538] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:30 2022] DELETE /identity/v3/projects/7ed39193ba7f4af6903fdcb758010131 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:30.423220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:30.430595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:30.432743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded607a-f070-46f8-b0bb-2bebedf4b95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:30.433446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded607a-f070-46f8-b0bb-2bebedf4b95d admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:30.436469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded607a-f070-46f8-b0bb-2bebedf4b95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:30.436825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded607a-f070-46f8-b0bb-2bebedf4b95d admin admin] PATH_INFO: `/v3/projects/6e0dd08f115c47548797127b2e416ae5/users/2f9045c9c8cc4e91913fb4bd7a2708f9/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:30.441792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded607a-f070-46f8-b0bb-2bebedf4b95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0dd08f115c47548797127b2e416ae5, user_id=2f9045c9c8cc4e91913fb4bd7a2708f9, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:30.455417 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded607a-f070-46f8-b0bb-2bebedf4b95d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:30.465294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b1db5-6556-4228-91f7-68b81ce20464 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:30.478741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 773/1539] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:30 2022] PUT /identity/v3/projects/6e0dd08f115c47548797127b2e416ae5/users/2f9045c9c8cc4e91913fb4bd7a2708f9/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:30.491193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a491204-5796-4caa-a430-94522ab294f8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:30.491760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a491204-5796-4caa-a430-94522ab294f8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:30.492130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a491204-5796-4caa-a430-94522ab294f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:30.528249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:30.539620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7a491204-5796-4caa-a430-94522ab294f8 None None] MFA Rules not processed for user `2f9045c9c8cc4e91913fb4bd7a2708f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:30.541362 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7a491204-5796-4caa-a430-94522ab294f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:30.566703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:30.597637 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:30.598687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:30.599112 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:30.599570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] PATH_INFO: `/v3/users/c397f1ea480c4116afdb02af0224ca19` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:30.600976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c397f1ea480c4116afdb02af0224ca19)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:30.603596 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:30.726587 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c397f1ea480c4116afdb02af0224ca19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:30.727440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 774/1540] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:30.730628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a491204-5796-4caa-a430-94522ab294f8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:30.732255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7a491204-5796-4caa-a430-94522ab294f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:30.735623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c397f1ea480c4116afdb02af0224ca19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:30.745748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c397f1ea480c4116afdb02af0224ca19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:30.758943 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c397f1ea480c4116afdb02af0224ca19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:30.759732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c397f1ea480c4116afdb02af0224ca19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:30.768133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 767/1541] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:30 2022] DELETE /identity/v3/users/c397f1ea480c4116afdb02af0224ca19 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:30.801742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a491204-5796-4caa-a430-94522ab294f8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:30.856078 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224db900-29bd-4251-9361-7787ecf9869e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:30.856690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224db900-29bd-4251-9361-7787ecf9869e service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:30.856970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224db900-29bd-4251-9361-7787ecf9869e service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:30.857256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224db900-29bd-4251-9361-7787ecf9869e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:30.859037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-224db900-29bd-4251-9361-7787ecf9869e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:30.927579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224db900-29bd-4251-9361-7787ecf9869e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:30.929037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224db900-29bd-4251-9361-7787ecf9869e service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:30.940180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 775/1542] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:31.071700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:31.073382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:31.310144 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b93329-e7dc-4939-9861-56169d84094c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:31.316164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:31.317788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:31.318384 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:31.318863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] PATH_INFO: `/v3/projects/66d6f2d390d147ae9adbecf71bead6d7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:31.320404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d6f2d390d147ae9adbecf71bead6d7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:31.322925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:31.392721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d6f2d390d147ae9adbecf71bead6d7', 'request_id': 'req-288056b5-9455-4311-a31d-8060b85f8170'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:31.415889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d6f2d390d147ae9adbecf71bead6d7', 'request_id': 'req-288056b5-9455-4311-a31d-8060b85f8170'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:31.426755 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d6f2d390d147ae9adbecf71bead6d7', 'request_id': 'req-288056b5-9455-4311-a31d-8060b85f8170'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:31.428436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:31.446674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] The token cache is being invalidate because project 66d6f2d390d147ae9adbecf71bead6d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:31.447122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:31.447926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-288056b5-9455-4311-a31d-8060b85f8170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:31.454307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 768/1543] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:31 2022] DELETE /identity/v3/projects/66d6f2d390d147ae9adbecf71bead6d7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:31.455655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e880af-a74e-4fe6-b236-879d0f19658d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:31.455945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e880af-a74e-4fe6-b236-879d0f19658d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:31.456224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e880af-a74e-4fe6-b236-879d0f19658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:31.501098 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:31.512959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a7e880af-a74e-4fe6-b236-879d0f19658d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:31.514613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a7e880af-a74e-4fe6-b236-879d0f19658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:31.625058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 776/1544] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:31.633945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b324-3681-475c-9106-ec9f3e43a507 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:31.634238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b324-3681-475c-9106-ec9f3e43a507 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:31.634518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b324-3681-475c-9106-ec9f3e43a507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:31.658786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b3c4b324-3681-475c-9106-ec9f3e43a507 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:31.660099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b3c4b324-3681-475c-9106-ec9f3e43a507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:31.669757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 769/1545] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:31.674733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e880af-a74e-4fe6-b236-879d0f19658d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:31.689119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e880af-a74e-4fe6-b236-879d0f19658d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:31.696558 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4afae-41a2-4653-8bec-a991dd8e11be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:31.697296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4afae-41a2-4653-8bec-a991dd8e11be admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:31.697645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4afae-41a2-4653-8bec-a991dd8e11be admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:31.698353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4afae-41a2-4653-8bec-a991dd8e11be admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:31.699218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4afae-41a2-4653-8bec-a991dd8e11be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:31.699552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4afae-41a2-4653-8bec-a991dd8e11be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:31.702348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4afae-41a2-4653-8bec-a991dd8e11be admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:31.724200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b324-3681-475c-9106-ec9f3e43a507 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:31.728868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 777/1546] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:31.739832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b324-3681-475c-9106-ec9f3e43a507 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:31.745719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dcd20-e38a-40b2-a161-70c30bc1d9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:31.746919 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dcd20-e38a-40b2-a161-70c30bc1d9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:31.747261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dcd20-e38a-40b2-a161-70c30bc1d9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:31.747574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dcd20-e38a-40b2-a161-70c30bc1d9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:31.748324 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dcd20-e38a-40b2-a161-70c30bc1d9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:31.750655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dcd20-e38a-40b2-a161-70c30bc1d9c8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:31.822561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4afae-41a2-4653-8bec-a991dd8e11be admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:31.828171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 770/1547] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:31 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:31.836547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4afae-41a2-4653-8bec-a991dd8e11be admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:31.850183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dcd20-e38a-40b2-a161-70c30bc1d9c8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:31.852106 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c96dcd20-e38a-40b2-a161-70c30bc1d9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:31.989060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fbd40-18c9-4e9e-a224-f357f33b9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:31.989731 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fbd40-18c9-4e9e-a224-f357f33b9ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:31.989967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fbd40-18c9-4e9e-a224-f357f33b9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:31.990245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fbd40-18c9-4e9e-a224-f357f33b9ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:31.997872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fbd40-18c9-4e9e-a224-f357f33b9ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:32.008732 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fbd40-18c9-4e9e-a224-f357f33b9ca0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:32.023815 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dcd20-e38a-40b2-a161-70c30bc1d9c8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:32.033189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:32.033789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.035638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.035920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] PATH_INFO: `/v3/users/480ba4ceaf8842b8ac07bf3fd3456fe1` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.038809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=480ba4ceaf8842b8ac07bf3fd3456fe1)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:32.042617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:32.071623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 778/1548] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:31 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:32.074534 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fbd40-18c9-4e9e-a224-f357f33b9ca0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:32.095802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fbd40-18c9-4e9e-a224-f357f33b9ca0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:32.106571 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2b8c-9525-45d1-bae1-0eb928ae48bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:32.107366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2b8c-9525-45d1-bae1-0eb928ae48bd admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.107627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2b8c-9525-45d1-bae1-0eb928ae48bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.107893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2b8c-9525-45d1-bae1-0eb928ae48bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.108585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2b8c-9525-45d1-bae1-0eb928ae48bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:32.114891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2b8c-9525-45d1-bae1-0eb928ae48bd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:32.133213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 779/1549] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:32.134221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2b8c-9525-45d1-bae1-0eb928ae48bd admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:32.146114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2b8c-9525-45d1-bae1-0eb928ae48bd admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:32.151862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735452c-8647-4b27-94f1-04974a694373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:32.152562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735452c-8647-4b27-94f1-04974a694373 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.152914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735452c-8647-4b27-94f1-04974a694373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.153268 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735452c-8647-4b27-94f1-04974a694373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.154149 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735452c-8647-4b27-94f1-04974a694373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:32.155888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735452c-8647-4b27-94f1-04974a694373 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:32.161458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480ba4ceaf8842b8ac07bf3fd3456fe1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:32.173109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 780/1550] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:32.174668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735452c-8647-4b27-94f1-04974a694373 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:32.179999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480ba4ceaf8842b8ac07bf3fd3456fe1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:32.186668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735452c-8647-4b27-94f1-04974a694373 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:32.192753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d79e4f-b888-44b9-9b70-620212f05f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:32.193122 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d79e4f-b888-44b9-9b70-620212f05f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.194198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d79e4f-b888-44b9-9b70-620212f05f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.194538 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d79e4f-b888-44b9-9b70-620212f05f9d admin admin] PATH_INFO: `/v3/projects/5c5c2ea60d04446fa0eb502ec8206d99/users/8235cdad79ca44f8a568e155d3358459/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.201363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480ba4ceaf8842b8ac07bf3fd3456fe1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:32.217639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d79e4f-b888-44b9-9b70-620212f05f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5c2ea60d04446fa0eb502ec8206d99, user_id=8235cdad79ca44f8a568e155d3358459, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:32.220623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d79e4f-b888-44b9-9b70-620212f05f9d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:32.224405 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480ba4ceaf8842b8ac07bf3fd3456fe1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:32.225146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4116a208-922e-4a45-9cfa-daabf3ac8d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480ba4ceaf8842b8ac07bf3fd3456fe1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:32.241151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 771/1551] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:31 2022] DELETE /identity/v3/users/480ba4ceaf8842b8ac07bf3fd3456fe1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:32.245542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046487d-96ca-4a1f-a6fc-159521991468 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.246193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046487d-96ca-4a1f-a6fc-159521991468 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.247749 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046487d-96ca-4a1f-a6fc-159521991468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.261636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 781/1552] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:32 2022] PUT /identity/v3/projects/5c5c2ea60d04446fa0eb502ec8206d99/users/8235cdad79ca44f8a568e155d3358459/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:32.272568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876937a-0c88-437b-b2d6-f2cadab1dc72 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.272965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876937a-0c88-437b-b2d6-f2cadab1dc72 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.273329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876937a-0c88-437b-b2d6-f2cadab1dc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.274277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3046487d-96ca-4a1f-a6fc-159521991468 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:32.276209 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3046487d-96ca-4a1f-a6fc-159521991468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:32.330451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0876937a-0c88-437b-b2d6-f2cadab1dc72 None None] MFA Rules not processed for user `8235cdad79ca44f8a568e155d3358459`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:32.332056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0876937a-0c88-437b-b2d6-f2cadab1dc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:32.367106 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:32.388176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:32.414576 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 772/1553] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:32.449102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046487d-96ca-4a1f-a6fc-159521991468 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:32.451035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3046487d-96ca-4a1f-a6fc-159521991468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:32.453956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 782/1554] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:32.459208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876937a-0c88-437b-b2d6-f2cadab1dc72 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:32.463167 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0876937a-0c88-437b-b2d6-f2cadab1dc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:32.480738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876937a-0c88-437b-b2d6-f2cadab1dc72 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:32.491703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7038c-109e-47db-8ba2-c8fb0f5b6003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:32.493196 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7038c-109e-47db-8ba2-c8fb0f5b6003 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.494998 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7038c-109e-47db-8ba2-c8fb0f5b6003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.495963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7038c-109e-47db-8ba2-c8fb0f5b6003 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.497186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7038c-109e-47db-8ba2-c8fb0f5b6003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:32.500376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7038c-109e-47db-8ba2-c8fb0f5b6003 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:32.551444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 783/1555] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:32 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:32.552644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7038c-109e-47db-8ba2-c8fb0f5b6003 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:32.630455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046487d-96ca-4a1f-a6fc-159521991468 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:32.669470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7038c-109e-47db-8ba2-c8fb0f5b6003 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:32.678335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304608-4036-48bf-afc2-5a8f51a03d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:32.679239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304608-4036-48bf-afc2-5a8f51a03d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.679835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304608-4036-48bf-afc2-5a8f51a03d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.680302 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304608-4036-48bf-afc2-5a8f51a03d86 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.682218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304608-4036-48bf-afc2-5a8f51a03d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:32.688885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304608-4036-48bf-afc2-5a8f51a03d86 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:32.705913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62030b-0498-4d6e-ad41-d66f5584bc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:32.707043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62030b-0498-4d6e-ad41-d66f5584bc1b service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.708162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62030b-0498-4d6e-ad41-d66f5584bc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.708548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62030b-0498-4d6e-ad41-d66f5584bc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.720821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62030b-0498-4d6e-ad41-d66f5584bc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:32.723853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62030b-0498-4d6e-ad41-d66f5584bc1b service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:32.736989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 773/1556] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:32.739053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 784/1557] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:32 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:21:32.740165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62030b-0498-4d6e-ad41-d66f5584bc1b service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:32.741520 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4a62030b-0498-4d6e-ad41-d66f5584bc1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:32.742985 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304608-4036-48bf-afc2-5a8f51a03d86 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:32.778341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304608-4036-48bf-afc2-5a8f51a03d86 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:32.794870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49731970-54bd-42b7-a90b-7b89ec359e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:32.795856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49731970-54bd-42b7-a90b-7b89ec359e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.796370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49731970-54bd-42b7-a90b-7b89ec359e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.797094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49731970-54bd-42b7-a90b-7b89ec359e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.798145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49731970-54bd-42b7-a90b-7b89ec359e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:32.805059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49731970-54bd-42b7-a90b-7b89ec359e87 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:32.833986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 785/1558] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:32.838942 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49731970-54bd-42b7-a90b-7b89ec359e87 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:32.849488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62030b-0498-4d6e-ad41-d66f5584bc1b service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:32.852115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49731970-54bd-42b7-a90b-7b89ec359e87 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:32.859484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1806c7-93a1-4d3b-adeb-9a661ad42885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:32.860119 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1806c7-93a1-4d3b-adeb-9a661ad42885 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.860404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1806c7-93a1-4d3b-adeb-9a661ad42885 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.860684 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1806c7-93a1-4d3b-adeb-9a661ad42885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.862385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b3b65-79bc-4ecf-8c16-0c51cf9d0fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:32.863051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b3b65-79bc-4ecf-8c16-0c51cf9d0fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:32.863354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b3b65-79bc-4ecf-8c16-0c51cf9d0fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:32.863627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b3b65-79bc-4ecf-8c16-0c51cf9d0fbb admin admin] PATH_INFO: `/v3/projects/74701848472b44b89412c41d504b2096/users/d3ecbffbf76a446897eb737c4b9bf373/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:32.865887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1e1806c7-93a1-4d3b-adeb-9a661ad42885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:32.890913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b3b65-79bc-4ecf-8c16-0c51cf9d0fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=74701848472b44b89412c41d504b2096, user_id=d3ecbffbf76a446897eb737c4b9bf373, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:32.893483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b3b65-79bc-4ecf-8c16-0c51cf9d0fbb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:32.920336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 786/1559] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:32 2022] PUT /identity/v3/projects/74701848472b44b89412c41d504b2096/users/d3ecbffbf76a446897eb737c4b9bf373/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:32.924541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b3b65-79bc-4ecf-8c16-0c51cf9d0fbb admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:33.007576 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:33.018203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1806c7-93a1-4d3b-adeb-9a661ad42885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:33.019710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1806c7-93a1-4d3b-adeb-9a661ad42885 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:33.041689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 774/1560] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:33.069478 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b3b65-79bc-4ecf-8c16-0c51cf9d0fbb admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:33.074562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506cfea-e6a9-4851-bef1-ea2cf196af1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:33.075188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506cfea-e6a9-4851-bef1-ea2cf196af1f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:33.075810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506cfea-e6a9-4851-bef1-ea2cf196af1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:33.076092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506cfea-e6a9-4851-bef1-ea2cf196af1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:33.076747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506cfea-e6a9-4851-bef1-ea2cf196af1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:33.078372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506cfea-e6a9-4851-bef1-ea2cf196af1f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:33.080482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:33.095838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 787/1561] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:33.099394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1806c7-93a1-4d3b-adeb-9a661ad42885 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:33.117306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1806c7-93a1-4d3b-adeb-9a661ad42885 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:33.124647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82ecc2-fedd-4258-b858-12fc75d61276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:33.125456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ecc2-fedd-4258-b858-12fc75d61276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:33.125855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ecc2-fedd-4258-b858-12fc75d61276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:33.126236 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82ecc2-fedd-4258-b858-12fc75d61276 admin admin] PATH_INFO: `/v3/projects/74701848472b44b89412c41d504b2096/users/d3ecbffbf76a446897eb737c4b9bf373/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:33.128926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82ecc2-fedd-4258-b858-12fc75d61276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74701848472b44b89412c41d504b2096, user_id=d3ecbffbf76a446897eb737c4b9bf373, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:33.132402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82ecc2-fedd-4258-b858-12fc75d61276 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:33.155954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 775/1562] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:33 2022] PUT /identity/v3/projects/74701848472b44b89412c41d504b2096/users/d3ecbffbf76a446897eb737c4b9bf373/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:33.169125 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677ab9d-5286-4454-84b7-eeaa437c891b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:33.169518 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677ab9d-5286-4454-84b7-eeaa437c891b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:33.170057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677ab9d-5286-4454-84b7-eeaa437c891b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:33.234716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b677ab9d-5286-4454-84b7-eeaa437c891b None None] MFA Rules not processed for user `d3ecbffbf76a446897eb737c4b9bf373`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:33.240571 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b677ab9d-5286-4454-84b7-eeaa437c891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:33.371762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 788/1563] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:33.382057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82ecc2-fedd-4258-b858-12fc75d61276 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:33.491674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677ab9d-5286-4454-84b7-eeaa437c891b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:33.493545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b677ab9d-5286-4454-84b7-eeaa437c891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:33.505649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82ecc2-fedd-4258-b858-12fc75d61276 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:33.511907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b6dd1-7bf7-44be-9dc3-b92452630c51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:33.512539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6dd1-7bf7-44be-9dc3-b92452630c51 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:33.512820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6dd1-7bf7-44be-9dc3-b92452630c51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:33.513095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b6dd1-7bf7-44be-9dc3-b92452630c51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:33.531184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b6dd1-7bf7-44be-9dc3-b92452630c51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:33.532963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b6dd1-7bf7-44be-9dc3-b92452630c51 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:33.557352 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 776/1564] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:33.715235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7378a13-3b4d-446e-8f86-429cc3425da3 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:33.715551 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7378a13-3b4d-446e-8f86-429cc3425da3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:33.715833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7378a13-3b4d-446e-8f86-429cc3425da3 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:33.717420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 777/1565] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:21:33.721368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677ab9d-5286-4454-84b7-eeaa437c891b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:33.734979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:33.735683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:33.735965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:33.736241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] PATH_INFO: `/v3/projects/9ca24c8d99aa4edea056de8d07c84ff9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:33.743257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca24c8d99aa4edea056de8d07c84ff9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:33.745558 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:33.755152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0ab2-ff6d-4f74-ab92-4abc5e647b17 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:33.755521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0ab2-ff6d-4f74-ab92-4abc5e647b17 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:33.755744 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0ab2-ff6d-4f74-ab92-4abc5e647b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:33.795621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e26d0ab2-ff6d-4f74-ab92-4abc5e647b17 None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:33.797866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e26d0ab2-ff6d-4f74-ab92-4abc5e647b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:33.866247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca24c8d99aa4edea056de8d07c84ff9', 'request_id': 'req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:33.872342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca24c8d99aa4edea056de8d07c84ff9', 'request_id': 'req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:33.880188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca24c8d99aa4edea056de8d07c84ff9', 'request_id': 'req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:33.916131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] The token cache is being invalidate because project 9ca24c8d99aa4edea056de8d07c84ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:33.916708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:33.918358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:33.924062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 789/1566] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:33 2022] DELETE /identity/v3/projects/9ca24c8d99aa4edea056de8d07c84ff9 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:33.928228 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:33.931044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 778/1567] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:33.931504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:33.948795 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:33.995367 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d0ab2-ff6d-4f74-ab92-4abc5e647b17 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:33.997849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e26d0ab2-ff6d-4f74-ab92-4abc5e647b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:34.035501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fd6f5-6182-4a9e-9576-f63ec30530fb admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:34.035616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d0ab2-ff6d-4f74-ab92-4abc5e647b17 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:34.048187 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:34.048869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:34.051307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:34.051307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] PATH_INFO: `/v3/users/0186e59106fe4120a5ac1f38b082010a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:34.051307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0186e59106fe4120a5ac1f38b082010a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:34.055632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:34.145483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0186e59106fe4120a5ac1f38b082010a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:34.147213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0186e59106fe4120a5ac1f38b082010a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:34.160359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0186e59106fe4120a5ac1f38b082010a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:34.172446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0186e59106fe4120a5ac1f38b082010a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:34.172568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a45d51-1666-4094-81e4-be4c9cf315d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:34.173551 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45d51-1666-4094-81e4-be4c9cf315d0 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:34.173774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0186e59106fe4120a5ac1f38b082010a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:34.173954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45d51-1666-4094-81e4-be4c9cf315d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:34.174294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a45d51-1666-4094-81e4-be4c9cf315d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:34.182229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-37a45d51-1666-4094-81e4-be4c9cf315d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:34.195208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 790/1568] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:33 2022] DELETE /identity/v3/users/0186e59106fe4120a5ac1f38b082010a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:34.199208 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a45d51-1666-4094-81e4-be4c9cf315d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:34.202794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a45d51-1666-4094-81e4-be4c9cf315d0 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:34.211714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:34.228578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 779/1569] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:34.764273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:34.765622 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:34.922014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094289e-e11b-43f5-b71e-03435658eea1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:34.941765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:34.942690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:34.944745 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:34.945247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] PATH_INFO: `/v3/projects/4537f88cdb1d4f5c9fbe4bd88a5e8dce` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:34.950445 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] RBAC: Authorizing `identity:delete_project(project_id=4537f88cdb1d4f5c9fbe4bd88a5e8dce)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:34.953626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:35.025918 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:35.045594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4537f88cdb1d4f5c9fbe4bd88a5e8dce', 'request_id': 'req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.053206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4537f88cdb1d4f5c9fbe4bd88a5e8dce', 'request_id': 'req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.060829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4537f88cdb1d4f5c9fbe4bd88a5e8dce', 'request_id': 'req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.094626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] The token cache is being invalidate because project 4537f88cdb1d4f5c9fbe4bd88a5e8dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:35.094945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.100478 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.103789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 791/1570] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:34 2022] DELETE /identity/v3/projects/4537f88cdb1d4f5c9fbe4bd88a5e8dce => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:35.107689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a45d51-1666-4094-81e4-be4c9cf315d0 service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:35.133425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a45d51-1666-4094-81e4-be4c9cf315d0 service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:35.274457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:35.275409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:35.275817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:35.276206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] PATH_INFO: `/v3/users/334649b307f94cdb8096f2b52343bd01` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:35.278908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=334649b307f94cdb8096f2b52343bd01)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:35.283903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:35.364845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334649b307f94cdb8096f2b52343bd01'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.379045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334649b307f94cdb8096f2b52343bd01'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.388800 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334649b307f94cdb8096f2b52343bd01'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.404362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334649b307f94cdb8096f2b52343bd01'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.405056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-121b9ded-f184-4e97-807a-d39fb82c1054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334649b307f94cdb8096f2b52343bd01'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.412031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 780/1571] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:35 2022] DELETE /identity/v3/users/334649b307f94cdb8096f2b52343bd01 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:35.736881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:35.738654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:35.775602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8905e-f96d-439a-9d9c-b51d96b7d2da admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:35.833217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:35.834282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:35.834725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:35.835189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] PATH_INFO: `/v3/projects/dbbd07d7782a400d9363715ea4f72fd9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:35.836860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbd07d7782a400d9363715ea4f72fd9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:35.839445 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:35.889771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbd07d7782a400d9363715ea4f72fd9', 'request_id': 'req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.896176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbd07d7782a400d9363715ea4f72fd9', 'request_id': 'req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.903872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbd07d7782a400d9363715ea4f72fd9', 'request_id': 'req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.922440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] The token cache is being invalidate because project dbbd07d7782a400d9363715ea4f72fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:35.922715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.923832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c3abe1fb-b1ef-4caf-9011-ce2611c3256d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:35.925635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 792/1572] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:35 2022] DELETE /identity/v3/projects/dbbd07d7782a400d9363715ea4f72fd9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:35.932577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aa136-4598-4ac4-a72d-881d5dbec157 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:35.933091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aa136-4598-4ac4-a72d-881d5dbec157 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:35.933495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aa136-4598-4ac4-a72d-881d5dbec157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:35.956676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c51aa136-4598-4ac4-a72d-881d5dbec157 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:35.958071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c51aa136-4598-4ac4-a72d-881d5dbec157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:36.087602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 781/1573] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:36.094523 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759e2d6-5cbc-470a-a2e5-244ad27ba912 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.099382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759e2d6-5cbc-470a-a2e5-244ad27ba912 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.099831 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759e2d6-5cbc-470a-a2e5-244ad27ba912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.141847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3759e2d6-5cbc-470a-a2e5-244ad27ba912 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:36.143685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3759e2d6-5cbc-470a-a2e5-244ad27ba912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:36.154343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 793/1574] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:36.158830 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51aa136-4598-4ac4-a72d-881d5dbec157 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:36.169411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51aa136-4598-4ac4-a72d-881d5dbec157 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:36.177182 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06cda-87fc-4b06-a9a1-e71f52d0b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:36.177964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06cda-87fc-4b06-a9a1-e71f52d0b331 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.178802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06cda-87fc-4b06-a9a1-e71f52d0b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.179238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06cda-87fc-4b06-a9a1-e71f52d0b331 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.180001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da06cda-87fc-4b06-a9a1-e71f52d0b331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:36.180458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da06cda-87fc-4b06-a9a1-e71f52d0b331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:36.182267 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da06cda-87fc-4b06-a9a1-e71f52d0b331 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:36.211351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759e2d6-5cbc-470a-a2e5-244ad27ba912 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:36.219171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 782/1575] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:36.227762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759e2d6-5cbc-470a-a2e5-244ad27ba912 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:36.234281 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c3db3-5702-421b-8279-5ff68ae671c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:36.236488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c3db3-5702-421b-8279-5ff68ae671c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.236777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c3db3-5702-421b-8279-5ff68ae671c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.237059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c3db3-5702-421b-8279-5ff68ae671c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.237756 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c3db3-5702-421b-8279-5ff68ae671c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:36.239978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c3db3-5702-421b-8279-5ff68ae671c0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:36.280760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 794/1576] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:36 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:21:36.285284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06cda-87fc-4b06-a9a1-e71f52d0b331 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:36.297235 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06cda-87fc-4b06-a9a1-e71f52d0b331 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:36.301907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:36.408231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961428e0-c91b-4d44-97b3-7a9ba9103930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:36.408231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961428e0-c91b-4d44-97b3-7a9ba9103930 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.408231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961428e0-c91b-4d44-97b3-7a9ba9103930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.408231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961428e0-c91b-4d44-97b3-7a9ba9103930 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.408548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961428e0-c91b-4d44-97b3-7a9ba9103930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:36.408548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961428e0-c91b-4d44-97b3-7a9ba9103930 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:36.446907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 783/1577] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:36 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:21:36.448094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c3db3-5702-421b-8279-5ff68ae671c0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:36.459427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c3db3-5702-421b-8279-5ff68ae671c0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:36.464454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c9e15-0aa4-4dff-ad83-b86030ef147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:36.467591 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9e15-0aa4-4dff-ad83-b86030ef147f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.467591 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9e15-0aa4-4dff-ad83-b86030ef147f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.467591 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9e15-0aa4-4dff-ad83-b86030ef147f admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.467591 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c9e15-0aa4-4dff-ad83-b86030ef147f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:36.467951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c9e15-0aa4-4dff-ad83-b86030ef147f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:36.481532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 795/1578] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:21:36.486155 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961428e0-c91b-4d44-97b3-7a9ba9103930 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:36.501299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961428e0-c91b-4d44-97b3-7a9ba9103930 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:36.506137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eac10b-bbe7-4be8-a0bc-dfe393f56aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:36.506757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eac10b-bbe7-4be8-a0bc-dfe393f56aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.507039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eac10b-bbe7-4be8-a0bc-dfe393f56aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.507348 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eac10b-bbe7-4be8-a0bc-dfe393f56aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.507995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eac10b-bbe7-4be8-a0bc-dfe393f56aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:36.509579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eac10b-bbe7-4be8-a0bc-dfe393f56aa8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:36.521024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 784/1579] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:21:36.525752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c9e15-0aa4-4dff-ad83-b86030ef147f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:36.537341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c9e15-0aa4-4dff-ad83-b86030ef147f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:36.542808 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0637a0-f9d9-4e67-8f5f-841681ad0d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:36.543696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0637a0-f9d9-4e67-8f5f-841681ad0d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.544044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0637a0-f9d9-4e67-8f5f-841681ad0d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.544624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0637a0-f9d9-4e67-8f5f-841681ad0d81 admin admin] PATH_INFO: `/v3/projects/a690708849e041e797981272698a1983/users/050c58e80b7a4daf961663898704363b/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.557775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eac10b-bbe7-4be8-a0bc-dfe393f56aa8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:36.560768 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:36.561687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-64eac10b-bbe7-4be8-a0bc-dfe393f56aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:36.569628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0637a0-f9d9-4e67-8f5f-841681ad0d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a690708849e041e797981272698a1983, user_id=050c58e80b7a4daf961663898704363b, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:36.575441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0637a0-f9d9-4e67-8f5f-841681ad0d81 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:36.581726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eac10b-bbe7-4be8-a0bc-dfe393f56aa8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:36.588418 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:36.589264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.589602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.589890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] PATH_INFO: `/v3/users/e7dfa8018ca1476b8e5be53f17dfb990` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.591450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7dfa8018ca1476b8e5be53f17dfb990)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:36.593747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 796/1580] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:36 2022] PUT /identity/v3/projects/a690708849e041e797981272698a1983/users/050c58e80b7a4daf961663898704363b/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:36.593871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:36.600148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0637a0-f9d9-4e67-8f5f-841681ad0d81 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:36.601891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ca0637a0-f9d9-4e67-8f5f-841681ad0d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:36.661446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7dfa8018ca1476b8e5be53f17dfb990'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:36.669049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7dfa8018ca1476b8e5be53f17dfb990'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:36.676818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0637a0-f9d9-4e67-8f5f-841681ad0d81 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:36.677881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7dfa8018ca1476b8e5be53f17dfb990'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:36.681915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:36.682545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.682835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.683093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] PATH_INFO: `/v3/users/8235cdad79ca44f8a568e155d3358459` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.684582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8235cdad79ca44f8a568e155d3358459)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:36.686712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:36.690490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7dfa8018ca1476b8e5be53f17dfb990'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:36.691155 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-73ad9ae1-4883-4d48-9f12-9be30b95f65a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7dfa8018ca1476b8e5be53f17dfb990'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:36.697669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 785/1581] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:36 2022] DELETE /identity/v3/users/e7dfa8018ca1476b8e5be53f17dfb990 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:36.698915 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5ade3-aed8-409e-a1c3-75a04d82f357 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.699203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5ade3-aed8-409e-a1c3-75a04d82f357 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.699593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5ade3-aed8-409e-a1c3-75a04d82f357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.733485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-60a5ade3-aed8-409e-a1c3-75a04d82f357 None None] MFA Rules not processed for user `050c58e80b7a4daf961663898704363b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:36.734958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-60a5ade3-aed8-409e-a1c3-75a04d82f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:36.741137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8235cdad79ca44f8a568e155d3358459'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:36.741870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8235cdad79ca44f8a568e155d3358459'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:36.750120 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8235cdad79ca44f8a568e155d3358459'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:36.758304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8235cdad79ca44f8a568e155d3358459'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:36.759174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-745db681-33be-4330-ba3e-af5407030d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8235cdad79ca44f8a568e155d3358459'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:36.783862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 797/1582] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:36 2022] DELETE /identity/v3/users/8235cdad79ca44f8a568e155d3358459 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:36.785574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96115921-400a-4a52-89fa-cffbcd25f5fe None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.786141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96115921-400a-4a52-89fa-cffbcd25f5fe None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.786665 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96115921-400a-4a52-89fa-cffbcd25f5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.795337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:36.810042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-96115921-400a-4a52-89fa-cffbcd25f5fe None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:36.811620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-96115921-400a-4a52-89fa-cffbcd25f5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:36.829850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 786/1583] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:36.829850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7ba58-66e9-46d8-a4b0-2763d4ae26fe None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.829850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7ba58-66e9-46d8-a4b0-2763d4ae26fe None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.829850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7ba58-66e9-46d8-a4b0-2763d4ae26fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.848241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-02a7ba58-66e9-46d8-a4b0-2763d4ae26fe None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:36.849603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-02a7ba58-66e9-46d8-a4b0-2763d4ae26fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:36.889392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 798/1584] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:36.890293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96115921-400a-4a52-89fa-cffbcd25f5fe None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:36.892513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-96115921-400a-4a52-89fa-cffbcd25f5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:36.907484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:36.926590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 787/1585] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:36.926590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7ba58-66e9-46d8-a4b0-2763d4ae26fe None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:36.926590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-02a7ba58-66e9-46d8-a4b0-2763d4ae26fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:36.991436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96115921-400a-4a52-89fa-cffbcd25f5fe None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:36.996627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d26240-196e-408d-9046-9ab4ea529459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:36.997766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d26240-196e-408d-9046-9ab4ea529459 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:36.998059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d26240-196e-408d-9046-9ab4ea529459 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:36.998341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d26240-196e-408d-9046-9ab4ea529459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:36.999001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7ba58-66e9-46d8-a4b0-2763d4ae26fe None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:37.003112 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3f9d9-7aee-4c72-8018-13cf75e9a3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:37.004133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3f9d9-7aee-4c72-8018-13cf75e9a3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:37.004913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3f9d9-7aee-4c72-8018-13cf75e9a3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:37.005412 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3f9d9-7aee-4c72-8018-13cf75e9a3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:37.017666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3f9d9-7aee-4c72-8018-13cf75e9a3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:37.019745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3f9d9-7aee-4c72-8018-13cf75e9a3e6 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:37.034844 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 788/1586] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:37.036076 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3f9d9-7aee-4c72-8018-13cf75e9a3e6 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:37.037563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-19a3f9d9-7aee-4c72-8018-13cf75e9a3e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:37.067487 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3f9d9-7aee-4c72-8018-13cf75e9a3e6 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:37.074901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:37.076248 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:37.076464 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:37.076735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] PATH_INFO: `/v3/users/1217f10d425641cbb12b0289fd599ab9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:37.078072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1217f10d425641cbb12b0289fd599ab9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:37.082267 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:37.094896 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d26240-196e-408d-9046-9ab4ea529459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:37.097954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d26240-196e-408d-9046-9ab4ea529459 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:37.108987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 799/1587] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:37.110007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d26240-196e-408d-9046-9ab4ea529459 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:37.111510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-19d26240-196e-408d-9046-9ab4ea529459 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:37.125823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d26240-196e-408d-9046-9ab4ea529459 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:37.132057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ca0f2-ed73-4f3c-8992-ba55b281a47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:37.132922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ca0f2-ed73-4f3c-8992-ba55b281a47e service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:37.133333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ca0f2-ed73-4f3c-8992-ba55b281a47e service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:37.133747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ca0f2-ed73-4f3c-8992-ba55b281a47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:37.150820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ca0f2-ed73-4f3c-8992-ba55b281a47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:37.153403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ca0f2-ed73-4f3c-8992-ba55b281a47e service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:37.167917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1217f10d425641cbb12b0289fd599ab9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:37.171697 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 800/1588] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:37.186476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1217f10d425641cbb12b0289fd599ab9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:37.208284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1217f10d425641cbb12b0289fd599ab9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:37.240823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1217f10d425641cbb12b0289fd599ab9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:37.242378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1217f10d425641cbb12b0289fd599ab9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:37.261606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 789/1589] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:37 2022] DELETE /identity/v3/users/1217f10d425641cbb12b0289fd599ab9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:37.263660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9bba4-5180-4450-bdfe-921095b81410 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:37.263979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9bba4-5180-4450-bdfe-921095b81410 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:37.264639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9bba4-5180-4450-bdfe-921095b81410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:37.316246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a9e9bba4-5180-4450-bdfe-921095b81410 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:37.319515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a9e9bba4-5180-4450-bdfe-921095b81410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:37.550422 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:37.552096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:37.573530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:37.691230 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58980f6-e438-4090-b315-73fce857f8b4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:37.710034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:37.710980 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:37.711409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:37.711838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] PATH_INFO: `/v3/projects/58e9cdfa0768442fb48d65224477992f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:37.714625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e9cdfa0768442fb48d65224477992f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:37.717692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:37.802718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e9cdfa0768442fb48d65224477992f', 'request_id': 'req-6a757241-fa71-4781-968d-014147925b71'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:37.812778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e9cdfa0768442fb48d65224477992f', 'request_id': 'req-6a757241-fa71-4781-968d-014147925b71'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:37.822085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e9cdfa0768442fb48d65224477992f', 'request_id': 'req-6a757241-fa71-4781-968d-014147925b71'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:37.829693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 801/1590] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 567 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:37.831214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9bba4-5180-4450-bdfe-921095b81410 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:37.834286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a9e9bba4-5180-4450-bdfe-921095b81410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:37.845044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] The token cache is being invalidate because project 58e9cdfa0768442fb48d65224477992f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:37.845406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:37.846052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:37.849567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 790/1591] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:37 2022] DELETE /identity/v3/projects/58e9cdfa0768442fb48d65224477992f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:37.851217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:37.852173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9bba4-5180-4450-bdfe-921095b81410 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:37.853816 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:37.916175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:37.932582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:37.933173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:37.933456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:37.933726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] PATH_INFO: `/v3/users/974c645d704f43f39a79d3b46da04dc2` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:37.934886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=974c645d704f43f39a79d3b46da04dc2)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:37.946074 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:37.964054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a757241-fa71-4781-968d-014147925b71 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:37.990241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad037c9b-b21e-431d-a6fe-442c1bc1003e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:37.992182 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad037c9b-b21e-431d-a6fe-442c1bc1003e service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:37.993878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad037c9b-b21e-431d-a6fe-442c1bc1003e service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:37.995485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad037c9b-b21e-431d-a6fe-442c1bc1003e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:38.002895 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ad037c9b-b21e-431d-a6fe-442c1bc1003e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:38.035898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad037c9b-b21e-431d-a6fe-442c1bc1003e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:38.037357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad037c9b-b21e-431d-a6fe-442c1bc1003e service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:38.050206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 791/1592] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:38.051116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad037c9b-b21e-431d-a6fe-442c1bc1003e service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:38.052729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ad037c9b-b21e-431d-a6fe-442c1bc1003e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:38.057552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974c645d704f43f39a79d3b46da04dc2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.058336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974c645d704f43f39a79d3b46da04dc2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.065247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad037c9b-b21e-431d-a6fe-442c1bc1003e service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:38.069088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974c645d704f43f39a79d3b46da04dc2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.070759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:38.071661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:38.072207 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:38.072207 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] PATH_INFO: `/v3/users/8591b644204949f498275e802ceee254` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:38.073423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] RBAC: Authorizing `identity:delete_user(user_id=8591b644204949f498275e802ceee254)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:38.076060 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:38.081716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974c645d704f43f39a79d3b46da04dc2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.082802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0fd2a083-662d-418a-980e-e41bce43e8aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974c645d704f43f39a79d3b46da04dc2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.121092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 802/1593] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:37 2022] DELETE /identity/v3/users/974c645d704f43f39a79d3b46da04dc2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:38.127309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aff6ce-8535-4865-8caa-de7e0b9dd3c8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:38.127309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aff6ce-8535-4865-8caa-de7e0b9dd3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:38.127784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aff6ce-8535-4865-8caa-de7e0b9dd3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:38.141435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:38.150757 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-68aff6ce-8535-4865-8caa-de7e0b9dd3c8 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:38.152217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-68aff6ce-8535-4865-8caa-de7e0b9dd3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:38.169963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8591b644204949f498275e802ceee254'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.188253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8591b644204949f498275e802ceee254'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.200303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8591b644204949f498275e802ceee254'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.221689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8591b644204949f498275e802ceee254'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.222839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8591b644204949f498275e802ceee254'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.232686 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 792/1594] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:38 2022] DELETE /identity/v3/users/8591b644204949f498275e802ceee254 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:38.234049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:38.235950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:38.272812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 803/1595] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:38.285873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aff6ce-8535-4865-8caa-de7e0b9dd3c8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:38.287294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-68aff6ce-8535-4865-8caa-de7e0b9dd3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:38.346267 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affae13b-f54b-4848-a813-76c5950044be admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:38.370035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:38.371050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:38.371050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:38.371357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] PATH_INFO: `/v3/projects/5c5c2ea60d04446fa0eb502ec8206d99` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:38.375251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aff6ce-8535-4865-8caa-de7e0b9dd3c8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:38.375946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5c2ea60d04446fa0eb502ec8206d99)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:38.378788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:38.412979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:38.463357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5c2ea60d04446fa0eb502ec8206d99', 'request_id': 'req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.465042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf061e7-7e37-458a-b3eb-684c21486691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:38.465663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf061e7-7e37-458a-b3eb-684c21486691 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:38.465939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf061e7-7e37-458a-b3eb-684c21486691 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:38.466278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf061e7-7e37-458a-b3eb-684c21486691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:38.475865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5c2ea60d04446fa0eb502ec8206d99', 'request_id': 'req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.477501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf061e7-7e37-458a-b3eb-684c21486691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:38.479309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf061e7-7e37-458a-b3eb-684c21486691 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:38.484936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5c2ea60d04446fa0eb502ec8206d99', 'request_id': 'req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.491771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 804/1596] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:38.499332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] The token cache is being invalidate because project 5c5c2ea60d04446fa0eb502ec8206d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:38.499631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.500309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.505615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 793/1597] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:38 2022] DELETE /identity/v3/projects/5c5c2ea60d04446fa0eb502ec8206d99 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:38.506936 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf061e7-7e37-458a-b3eb-684c21486691 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:38.517897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf061e7-7e37-458a-b3eb-684c21486691 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:38.587387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:38.588533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:38.588827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:38.589105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] PATH_INFO: `/v3/users/d3ecbffbf76a446897eb737c4b9bf373` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:38.590307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ecbffbf76a446897eb737c4b9bf373)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:38.592288 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:38.620160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:38.621853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:38.637525 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f55d47-0c27-46fa-9fe9-0de4b985f2c8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:38.642474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:38.643172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:38.643704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:38.644251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] PATH_INFO: `/v3/projects/849b86031b4d4555a0f5708efad1dc68` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:38.645547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=849b86031b4d4555a0f5708efad1dc68)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:38.647353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ecbffbf76a446897eb737c4b9bf373'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.648471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ecbffbf76a446897eb737c4b9bf373'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.653366 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:38.671038 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ecbffbf76a446897eb737c4b9bf373'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.680777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ecbffbf76a446897eb737c4b9bf373'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.681300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ecbffbf76a446897eb737c4b9bf373'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.702570 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:38.704434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 805/1598] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:38 2022] DELETE /identity/v3/users/d3ecbffbf76a446897eb737c4b9bf373 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:38.732276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849b86031b4d4555a0f5708efad1dc68', 'request_id': 'req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.747084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849b86031b4d4555a0f5708efad1dc68', 'request_id': 'req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.757742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849b86031b4d4555a0f5708efad1dc68', 'request_id': 'req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.776196 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] The token cache is being invalidate because project 849b86031b4d4555a0f5708efad1dc68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:38.776514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.777564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:38.779786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 794/1599] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:38 2022] DELETE /identity/v3/projects/849b86031b4d4555a0f5708efad1dc68 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:38.796022 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:38.805170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:38.820658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:38.822583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:38.929691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:38.934359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ca93-bb46-4844-86ca-fe7c9bff1f50 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:38.953737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc285d68-3923-469f-a057-75baac58af0d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:38.959900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:38.960960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:38.961833 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:38.964620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] PATH_INFO: `/v3/users/7c314b0c007d4eeba2b2c07ce81f7316` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:38.966418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c314b0c007d4eeba2b2c07ce81f7316)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:38.969516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:39.090023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:39.090852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:39.091316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:39.091654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] PATH_INFO: `/v3/projects/ea64f2154c0d44a8815ddb7781e35eef` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:39.093147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea64f2154c0d44a8815ddb7781e35eef)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:39.097283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:39.140020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c314b0c007d4eeba2b2c07ce81f7316'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.140859 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c314b0c007d4eeba2b2c07ce81f7316'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.151559 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c314b0c007d4eeba2b2c07ce81f7316'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.162229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c314b0c007d4eeba2b2c07ce81f7316'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.163380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c314b0c007d4eeba2b2c07ce81f7316'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.184876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 806/1600] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:38 2022] DELETE /identity/v3/users/7c314b0c007d4eeba2b2c07ce81f7316 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:39.185908 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:39.186933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea64f2154c0d44a8815ddb7781e35eef', 'request_id': 'req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.189778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:39.197323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea64f2154c0d44a8815ddb7781e35eef', 'request_id': 'req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.206897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea64f2154c0d44a8815ddb7781e35eef', 'request_id': 'req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.217217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:39.228229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] The token cache is being invalidate because project ea64f2154c0d44a8815ddb7781e35eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:39.228961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.229890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4ca2118b-866b-43bb-bfa2-9de4ea4cb03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.233497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 795/1601] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:38 2022] DELETE /identity/v3/projects/ea64f2154c0d44a8815ddb7781e35eef => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:39.239113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9d49f-e0cf-4b5c-8958-69b07d44a92a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:39.239550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9d49f-e0cf-4b5c-8958-69b07d44a92a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:39.239891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9d49f-e0cf-4b5c-8958-69b07d44a92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:39.303891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d39e4-3eaa-42a7-aca9-776ab255d6cc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:39.320452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:39.321146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:39.321431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:39.321710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] PATH_INFO: `/v3/projects/d179687d742c45b99b8441ef8382c46a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:39.322969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d179687d742c45b99b8441ef8382c46a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:39.325301 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:39.418762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5aa9d49f-e0cf-4b5c-8958-69b07d44a92a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:39.420025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5aa9d49f-e0cf-4b5c-8958-69b07d44a92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:39.429454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd179687d742c45b99b8441ef8382c46a', 'request_id': 'req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.443358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd179687d742c45b99b8441ef8382c46a', 'request_id': 'req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.458223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd179687d742c45b99b8441ef8382c46a', 'request_id': 'req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.464734 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:39.485609 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] The token cache is being invalidate because project d179687d742c45b99b8441ef8382c46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:39.486876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.487675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.489355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 807/1602] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:39 2022] DELETE /identity/v3/projects/d179687d742c45b99b8441ef8382c46a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:39.494007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:39.495940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:39.526593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 796/1603] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:39.534277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ed869-4edf-46ec-aaa0-7030a7a9cd98 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:39.534561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ed869-4edf-46ec-aaa0-7030a7a9cd98 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:39.534841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ed869-4edf-46ec-aaa0-7030a7a9cd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:39.576290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6a4ed869-4edf-46ec-aaa0-7030a7a9cd98 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:39.580884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6a4ed869-4edf-46ec-aaa0-7030a7a9cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:39.598484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 797/1604] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:39.598484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ed869-4edf-46ec-aaa0-7030a7a9cd98 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:39.600164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6a4ed869-4edf-46ec-aaa0-7030a7a9cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:39.631610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ed869-4edf-46ec-aaa0-7030a7a9cd98 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:39.638420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:39.638420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:39.638420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:39.638420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] PATH_INFO: `/v3/projects/74701848472b44b89412c41d504b2096` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:39.638790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74701848472b44b89412c41d504b2096)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:39.640156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:39.658996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a045de2-50a9-49dc-8a99-ab5c5ca951e2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:39.664882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:39.665304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:39.665586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:39.665854 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] PATH_INFO: `/v3/users/2f9045c9c8cc4e91913fb4bd7a2708f9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:39.667063 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9045c9c8cc4e91913fb4bd7a2708f9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:39.669444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:39.702852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74701848472b44b89412c41d504b2096', 'request_id': 'req-f974b108-c82e-43bc-acdb-6d3049d86539'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.711372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74701848472b44b89412c41d504b2096', 'request_id': 'req-f974b108-c82e-43bc-acdb-6d3049d86539'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.717899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74701848472b44b89412c41d504b2096', 'request_id': 'req-f974b108-c82e-43bc-acdb-6d3049d86539'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.725575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9045c9c8cc4e91913fb4bd7a2708f9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.725841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9045c9c8cc4e91913fb4bd7a2708f9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.732448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] The token cache is being invalidate because project 74701848472b44b89412c41d504b2096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:39.732772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.733554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.734863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9045c9c8cc4e91913fb4bd7a2708f9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.735442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 798/1605] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:39 2022] DELETE /identity/v3/projects/74701848472b44b89412c41d504b2096 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:39.736213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:39.737702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:39.748392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9045c9c8cc4e91913fb4bd7a2708f9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.750138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-45c81c59-b712-41b2-b153-b4635500db09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9045c9c8cc4e91913fb4bd7a2708f9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:39.773846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 808/1606] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:39 2022] DELETE /identity/v3/users/2f9045c9c8cc4e91913fb4bd7a2708f9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:39.779376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d7cf-1a80-43de-8c32-3c4fc4aba74c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:39.779376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d7cf-1a80-43de-8c32-3c4fc4aba74c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:39.779376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852d7cf-1a80-43de-8c32-3c4fc4aba74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:39.830729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1852d7cf-1a80-43de-8c32-3c4fc4aba74c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:39.833244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1852d7cf-1a80-43de-8c32-3c4fc4aba74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:39.855431 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974b108-c82e-43bc-acdb-6d3049d86539 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:39.891698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:39.926524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 809/1607] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:39.926524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852d7cf-1a80-43de-8c32-3c4fc4aba74c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:39.926524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1852d7cf-1a80-43de-8c32-3c4fc4aba74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:39.939882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852d7cf-1a80-43de-8c32-3c4fc4aba74c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:39.949828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344f18-a1fd-48b9-b26e-d82db7365406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:39.951033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344f18-a1fd-48b9-b26e-d82db7365406 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:39.951506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344f18-a1fd-48b9-b26e-d82db7365406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:39.951889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344f18-a1fd-48b9-b26e-d82db7365406 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:39.952719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344f18-a1fd-48b9-b26e-d82db7365406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:39.953139 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344f18-a1fd-48b9-b26e-d82db7365406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:39.955641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344f18-a1fd-48b9-b26e-d82db7365406 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:39.974466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:39.977442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:39.979601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:39.980066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] PATH_INFO: `/v3/projects/c84438aa99f44ea0b9bc7fdb0beb566c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:39.987660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84438aa99f44ea0b9bc7fdb0beb566c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:39.991002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:39.991659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 799/1608] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:39.993120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93d472-af09-469b-a3a7-29e90ac02b6a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:39.993906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93d472-af09-469b-a3a7-29e90ac02b6a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:39.994198 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93d472-af09-469b-a3a7-29e90ac02b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.013072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:40.024957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1f93d472-af09-469b-a3a7-29e90ac02b6a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:40.026244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1f93d472-af09-469b-a3a7-29e90ac02b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.037478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 800/1609] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:40.038408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93d472-af09-469b-a3a7-29e90ac02b6a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.039959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1f93d472-af09-469b-a3a7-29e90ac02b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.055306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93d472-af09-469b-a3a7-29e90ac02b6a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.063154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6adc6-2007-4316-9e5f-af613edb1a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:40.064483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6adc6-2007-4316-9e5f-af613edb1a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.064767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6adc6-2007-4316-9e5f-af613edb1a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.065131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6adc6-2007-4316-9e5f-af613edb1a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.065826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6adc6-2007-4316-9e5f-af613edb1a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:40.067941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6adc6-2007-4316-9e5f-af613edb1a00 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:40.088197 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84438aa99f44ea0b9bc7fdb0beb566c', 'request_id': 'req-d8122d93-bde5-4fa5-9621-221abdd5275b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.096474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84438aa99f44ea0b9bc7fdb0beb566c', 'request_id': 'req-d8122d93-bde5-4fa5-9621-221abdd5275b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.119028 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84438aa99f44ea0b9bc7fdb0beb566c', 'request_id': 'req-d8122d93-bde5-4fa5-9621-221abdd5275b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.120992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 801/1610] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:40 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:40.121929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6adc6-2007-4316-9e5f-af613edb1a00 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.156762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] The token cache is being invalidate because project c84438aa99f44ea0b9bc7fdb0beb566c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:40.157140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.158425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.165086 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 810/1611] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:39 2022] DELETE /identity/v3/projects/c84438aa99f44ea0b9bc7fdb0beb566c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:40.165982 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.168119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.254920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6adc6-2007-4316-9e5f-af613edb1a00 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.266356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280bb59-22a1-486f-9a84-f62e73fcf9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:40.267236 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280bb59-22a1-486f-9a84-f62e73fcf9dd admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.267618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280bb59-22a1-486f-9a84-f62e73fcf9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.267961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280bb59-22a1-486f-9a84-f62e73fcf9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.268688 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280bb59-22a1-486f-9a84-f62e73fcf9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:40.269061 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280bb59-22a1-486f-9a84-f62e73fcf9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:40.270731 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280bb59-22a1-486f-9a84-f62e73fcf9dd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:40.286471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8122d93-bde5-4fa5-9621-221abdd5275b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.301508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cc665-1b42-43d4-9f98-5f992f0f0b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:40.302152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc665-1b42-43d4-9f98-5f992f0f0b6c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.302520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc665-1b42-43d4-9f98-5f992f0f0b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.302720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc665-1b42-43d4-9f98-5f992f0f0b6c admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.303464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cc665-1b42-43d4-9f98-5f992f0f0b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:40.305285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cc665-1b42-43d4-9f98-5f992f0f0b6c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:40.306551 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 802/1612] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:40.307232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280bb59-22a1-486f-9a84-f62e73fcf9dd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.312511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e280bb59-22a1-486f-9a84-f62e73fcf9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.343004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280bb59-22a1-486f-9a84-f62e73fcf9dd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.347094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 811/1613] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:40 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:40.348809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc895b-24b6-4014-a488-22afc58f4f38 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.349093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc895b-24b6-4014-a488-22afc58f4f38 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.349363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc895b-24b6-4014-a488-22afc58f4f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.358108 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:40.359164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.359164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.359502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] PATH_INFO: `/v3/projects/6e0dd08f115c47548797127b2e416ae5` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.361875 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0dd08f115c47548797127b2e416ae5)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:40.364918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:40.389620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-65bc895b-24b6-4014-a488-22afc58f4f38 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:40.396666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-65bc895b-24b6-4014-a488-22afc58f4f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.421663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 812/1614] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:40.423736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc895b-24b6-4014-a488-22afc58f4f38 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.430970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-65bc895b-24b6-4014-a488-22afc58f4f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.447223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc895b-24b6-4014-a488-22afc58f4f38 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.448197 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0dd08f115c47548797127b2e416ae5', 'request_id': 'req-4d63b848-e1e9-4acf-9219-df421569ab93'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.459535 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0dd08f115c47548797127b2e416ae5', 'request_id': 'req-4d63b848-e1e9-4acf-9219-df421569ab93'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.468394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0dd08f115c47548797127b2e416ae5', 'request_id': 'req-4d63b848-e1e9-4acf-9219-df421569ab93'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.483715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] The token cache is being invalidate because project 6e0dd08f115c47548797127b2e416ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:40.484200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.484894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.487175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 803/1615] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:40 2022] DELETE /identity/v3/projects/6e0dd08f115c47548797127b2e416ae5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:40.487973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.489395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.496524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:40.527487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:40.528410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.528841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.529261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] PATH_INFO: `/v3/users/050c58e80b7a4daf961663898704363b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.530869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050c58e80b7a4daf961663898704363b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:40.534334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:40.583349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:40.586792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63b848-e1e9-4acf-9219-df421569ab93 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.595679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d2582-4857-47c3-a828-0c07784188a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:40.596470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d2582-4857-47c3-a828-0c07784188a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.596807 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d2582-4857-47c3-a828-0c07784188a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.597143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d2582-4857-47c3-a828-0c07784188a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.598286 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d2582-4857-47c3-a828-0c07784188a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:40.602525 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d2582-4857-47c3-a828-0c07784188a8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:40.637961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050c58e80b7a4daf961663898704363b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.639116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050c58e80b7a4daf961663898704363b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.649534 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 804/1616] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:40 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:40.650393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d2582-4857-47c3-a828-0c07784188a8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.653370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050c58e80b7a4daf961663898704363b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.658720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dd5d2582-4857-47c3-a828-0c07784188a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.664740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050c58e80b7a4daf961663898704363b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.665970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3fb073c8-3fa0-4f86-b6d4-001e2892f420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050c58e80b7a4daf961663898704363b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:40.696077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 813/1617] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:40 2022] DELETE /identity/v3/users/050c58e80b7a4daf961663898704363b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:40.699074 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2401f-c876-4b93-807a-94eb4b045b80 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.699510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2401f-c876-4b93-807a-94eb4b045b80 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.699937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2401f-c876-4b93-807a-94eb4b045b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.733652 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-76f2401f-c876-4b93-807a-94eb4b045b80 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:40.734997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-76f2401f-c876-4b93-807a-94eb4b045b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.746225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d2582-4857-47c3-a828-0c07784188a8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.823703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798b8f8-b0f3-4a5c-8d6e-9f51937ccb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:40.824620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b8f8-b0f3-4a5c-8d6e-9f51937ccb11 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.824997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b8f8-b0f3-4a5c-8d6e-9f51937ccb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.825364 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b8f8-b0f3-4a5c-8d6e-9f51937ccb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.826391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798b8f8-b0f3-4a5c-8d6e-9f51937ccb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:40.826898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 814/1618] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:40.828347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c70b96-01a4-45ef-9fff-02759499fa73 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.828637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c70b96-01a4-45ef-9fff-02759499fa73 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.828970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798b8f8-b0f3-4a5c-8d6e-9f51937ccb11 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:40.829092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c70b96-01a4-45ef-9fff-02759499fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.853189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-32c70b96-01a4-45ef-9fff-02759499fa73 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:40.854265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 805/1619] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:40.854417 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-32c70b96-01a4-45ef-9fff-02759499fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.855300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798b8f8-b0f3-4a5c-8d6e-9f51937ccb11 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.857162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6798b8f8-b0f3-4a5c-8d6e-9f51937ccb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.864064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 815/1620] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:40.865581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58cf3e-e3f9-45aa-aac9-9147d35495c9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.866109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58cf3e-e3f9-45aa-aac9-9147d35495c9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.866582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58cf3e-e3f9-45aa-aac9-9147d35495c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.881361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798b8f8-b0f3-4a5c-8d6e-9f51937ccb11 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.886332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a8874-8c6b-4aa3-92ff-c08cde3da548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:40.887013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a8874-8c6b-4aa3-92ff-c08cde3da548 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.887327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a8874-8c6b-4aa3-92ff-c08cde3da548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.887608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a8874-8c6b-4aa3-92ff-c08cde3da548 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.888252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a8874-8c6b-4aa3-92ff-c08cde3da548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:40.888567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4e58cf3e-e3f9-45aa-aac9-9147d35495c9 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:40.889993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4e58cf3e-e3f9-45aa-aac9-9147d35495c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.890843 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a8874-8c6b-4aa3-92ff-c08cde3da548 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:40.904235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 816/1621] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:40.905246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58cf3e-e3f9-45aa-aac9-9147d35495c9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.918809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58cf3e-e3f9-45aa-aac9-9147d35495c9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.920708 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 806/1622] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:40 2022] POST /identity/v3/users => generated 293 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:40.921775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a8874-8c6b-4aa3-92ff-c08cde3da548 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.930153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-867a8874-8c6b-4aa3-92ff-c08cde3da548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.930630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6ebf8-1c0a-4fad-bb4a-0f2eb72fdec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:40.932072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ebf8-1c0a-4fad-bb4a-0f2eb72fdec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.932630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ebf8-1c0a-4fad-bb4a-0f2eb72fdec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.933567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ebf8-1c0a-4fad-bb4a-0f2eb72fdec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.934446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6ebf8-1c0a-4fad-bb4a-0f2eb72fdec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:40.934967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6ebf8-1c0a-4fad-bb4a-0f2eb72fdec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:40.937607 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6ebf8-1c0a-4fad-bb4a-0f2eb72fdec1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:40.944938 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a8874-8c6b-4aa3-92ff-c08cde3da548 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.949927 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06b739-2f07-4126-8fb0-2221cc33bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:40.951040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06b739-2f07-4126-8fb0-2221cc33bcee admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.951296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06b739-2f07-4126-8fb0-2221cc33bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.951646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06b739-2f07-4126-8fb0-2221cc33bcee admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.952234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06b739-2f07-4126-8fb0-2221cc33bcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:40.957394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 817/1623] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:40.957926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06b739-2f07-4126-8fb0-2221cc33bcee admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:40.958007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434b28f-29a8-4b4d-aa32-4304c13e27ad None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:40.958007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434b28f-29a8-4b4d-aa32-4304c13e27ad None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:40.958007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434b28f-29a8-4b4d-aa32-4304c13e27ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:40.975449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 807/1624] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:40.976421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06b739-2f07-4126-8fb0-2221cc33bcee admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.982712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-2434b28f-29a8-4b4d-aa32-4304c13e27ad None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:40.983979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2434b28f-29a8-4b4d-aa32-4304c13e27ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:40.984999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:40.991899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06b739-2f07-4126-8fb0-2221cc33bcee admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:40.993105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 818/1625] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:40.994581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434b28f-29a8-4b4d-aa32-4304c13e27ad None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:40.995982 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2434b28f-29a8-4b4d-aa32-4304c13e27ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:41.003164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ce876-2adc-4d5c-b6f5-a5c68c8ba52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.003908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce876-2adc-4d5c-b6f5-a5c68c8ba52c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.004260 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce876-2adc-4d5c-b6f5-a5c68c8ba52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.004603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ce876-2adc-4d5c-b6f5-a5c68c8ba52c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.005467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ce876-2adc-4d5c-b6f5-a5c68c8ba52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.007623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ce876-2adc-4d5c-b6f5-a5c68c8ba52c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.025350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 808/1626] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:41.025350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ce876-2adc-4d5c-b6f5-a5c68c8ba52c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.036686 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ce876-2adc-4d5c-b6f5-a5c68c8ba52c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.042853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ae180-71ac-4200-9962-25fc00bb3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.043651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ae180-71ac-4200-9962-25fc00bb3abb admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.043999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ae180-71ac-4200-9962-25fc00bb3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.044344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ae180-71ac-4200-9962-25fc00bb3abb admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.045071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ae180-71ac-4200-9962-25fc00bb3abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.047175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ae180-71ac-4200-9962-25fc00bb3abb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.092140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 809/1627] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:41 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:41.092408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434b28f-29a8-4b4d-aa32-4304c13e27ad None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.092500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ae180-71ac-4200-9962-25fc00bb3abb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.132952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:41.164886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149890d3-653f-43ba-bf86-6bf039a52271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.165595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149890d3-653f-43ba-bf86-6bf039a52271 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.165868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149890d3-653f-43ba-bf86-6bf039a52271 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.166147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149890d3-653f-43ba-bf86-6bf039a52271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.172244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ae180-71ac-4200-9962-25fc00bb3abb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.175470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149890d3-653f-43ba-bf86-6bf039a52271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.176835 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d698f-597d-46f4-8523-3083f3aea1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.176975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149890d3-653f-43ba-bf86-6bf039a52271 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.177484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d698f-597d-46f4-8523-3083f3aea1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.177757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d698f-597d-46f4-8523-3083f3aea1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.178025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d698f-597d-46f4-8523-3083f3aea1d9 admin admin] PATH_INFO: `/v3/projects/584cc64b3ee54c7bb6f101d84bf704b4/users/06b7c4fa2b3d47efae32a3ec153a32f4/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.186297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 819/1628] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:41.187027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149890d3-653f-43ba-bf86-6bf039a52271 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.194685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d698f-597d-46f4-8523-3083f3aea1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584cc64b3ee54c7bb6f101d84bf704b4, user_id=06b7c4fa2b3d47efae32a3ec153a32f4, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.196547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149890d3-653f-43ba-bf86-6bf039a52271 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.197548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d698f-597d-46f4-8523-3083f3aea1d9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.202873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfc9bd-d204-422f-bd27-ff75cc764b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.203939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc9bd-d204-422f-bd27-ff75cc764b1f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.204911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc9bd-d204-422f-bd27-ff75cc764b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.205151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc9bd-d204-422f-bd27-ff75cc764b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.205942 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfc9bd-d204-422f-bd27-ff75cc764b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:41.206470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfc9bd-d204-422f-bd27-ff75cc764b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.208257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfc9bd-d204-422f-bd27-ff75cc764b1f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.214506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 810/1629] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:41 2022] PUT /identity/v3/projects/584cc64b3ee54c7bb6f101d84bf704b4/users/06b7c4fa2b3d47efae32a3ec153a32f4/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:41.216276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d698f-597d-46f4-8523-3083f3aea1d9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.222639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 820/1630] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:41.223847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfc9bd-d204-422f-bd27-ff75cc764b1f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.235589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfc9bd-d204-422f-bd27-ff75cc764b1f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.297008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d698f-597d-46f4-8523-3083f3aea1d9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.302466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257b6d6-4552-4651-a363-807af7b9d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.303077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257b6d6-4552-4651-a363-807af7b9d716 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.303393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257b6d6-4552-4651-a363-807af7b9d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.303922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257b6d6-4552-4651-a363-807af7b9d716 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.305161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0944de5-8ae8-4c59-8993-e2943f8738f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.306604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0944de5-8ae8-4c59-8993-e2943f8738f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.307094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0944de5-8ae8-4c59-8993-e2943f8738f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.307628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0944de5-8ae8-4c59-8993-e2943f8738f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.308670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0944de5-8ae8-4c59-8993-e2943f8738f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.309789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257b6d6-4552-4651-a363-807af7b9d716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.310721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0944de5-8ae8-4c59-8993-e2943f8738f0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.313329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257b6d6-4552-4651-a363-807af7b9d716 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.324047 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 811/1631] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:41.326057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25fbe3-57db-4164-a21c-2f9699f5bacd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.326573 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25fbe3-57db-4164-a21c-2f9699f5bacd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.327049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25fbe3-57db-4164-a21c-2f9699f5bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.343208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 821/1632] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:41 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:41.343208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257b6d6-4552-4651-a363-807af7b9d716 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.357175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257b6d6-4552-4651-a363-807af7b9d716 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.363408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b909c0-7fda-4e29-bcb4-7cd0c2d44d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.364166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b909c0-7fda-4e29-bcb4-7cd0c2d44d95 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.364525 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b909c0-7fda-4e29-bcb4-7cd0c2d44d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.364876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b909c0-7fda-4e29-bcb4-7cd0c2d44d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.365529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-af25fbe3-57db-4164-a21c-2f9699f5bacd None None] MFA Rules not processed for user `06b7c4fa2b3d47efae32a3ec153a32f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:41.365636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b909c0-7fda-4e29-bcb4-7cd0c2d44d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.366732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-af25fbe3-57db-4164-a21c-2f9699f5bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:41.367770 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b909c0-7fda-4e29-bcb4-7cd0c2d44d95 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.403940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 822/1633] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:41 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:41.404964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b909c0-7fda-4e29-bcb4-7cd0c2d44d95 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.416950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:41.451637 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 812/1634] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:41.452763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25fbe3-57db-4164-a21c-2f9699f5bacd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.465875 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25fbe3-57db-4164-a21c-2f9699f5bacd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.505468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b909c0-7fda-4e29-bcb4-7cd0c2d44d95 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.514089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26494b-9d3d-483c-97eb-a1a8f3d89c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.514767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26494b-9d3d-483c-97eb-a1a8f3d89c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.515067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26494b-9d3d-483c-97eb-a1a8f3d89c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.515376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26494b-9d3d-483c-97eb-a1a8f3d89c50 admin admin] PATH_INFO: `/v3/projects/9d3527e8ee3f47ecb19e04323432e610/users/13997f61d7874b1b9f2ac9ac1db4fd9c/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.538249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26494b-9d3d-483c-97eb-a1a8f3d89c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3527e8ee3f47ecb19e04323432e610, user_id=13997f61d7874b1b9f2ac9ac1db4fd9c, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.543395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26494b-9d3d-483c-97eb-a1a8f3d89c50 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.553600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca336-98dc-45e3-9b7f-89b5060476e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.554663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca336-98dc-45e3-9b7f-89b5060476e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.555958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca336-98dc-45e3-9b7f-89b5060476e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.555958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca336-98dc-45e3-9b7f-89b5060476e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.556386 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ca336-98dc-45e3-9b7f-89b5060476e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.558374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ca336-98dc-45e3-9b7f-89b5060476e0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.560546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 823/1635] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:41 2022] PUT /identity/v3/projects/9d3527e8ee3f47ecb19e04323432e610/users/13997f61d7874b1b9f2ac9ac1db4fd9c/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:41.561225 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26494b-9d3d-483c-97eb-a1a8f3d89c50 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.568160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:41.582515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 813/1636] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:41.583735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca336-98dc-45e3-9b7f-89b5060476e0 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.585398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cd4ca336-98dc-45e3-9b7f-89b5060476e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:41.639877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26494b-9d3d-483c-97eb-a1a8f3d89c50 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.645112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c13b67-0089-488d-8582-46823f400e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.645823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c13b67-0089-488d-8582-46823f400e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.646166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c13b67-0089-488d-8582-46823f400e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.646517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c13b67-0089-488d-8582-46823f400e81 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.647233 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c13b67-0089-488d-8582-46823f400e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.648475 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca336-98dc-45e3-9b7f-89b5060476e0 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.649414 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c13b67-0089-488d-8582-46823f400e81 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.672170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 824/1637] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:41 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:41.673971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c13b67-0089-488d-8582-46823f400e81 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.675563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-57c13b67-0089-488d-8582-46823f400e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:41.687442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c13b67-0089-488d-8582-46823f400e81 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.692284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.692900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.693179 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.693450 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] PATH_INFO: `/v3/projects/a690708849e041e797981272698a1983` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.694555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a690708849e041e797981272698a1983)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.696468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.701263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe319761-9c1d-4acc-8bc7-cb5279b9960b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.701874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe319761-9c1d-4acc-8bc7-cb5279b9960b service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.702150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe319761-9c1d-4acc-8bc7-cb5279b9960b service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.702462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe319761-9c1d-4acc-8bc7-cb5279b9960b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.746609 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a690708849e041e797981272698a1983', 'request_id': 'req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:41.750454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:41.752919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a690708849e041e797981272698a1983', 'request_id': 'req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:41.759831 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a690708849e041e797981272698a1983', 'request_id': 'req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:41.763495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe319761-9c1d-4acc-8bc7-cb5279b9960b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.765048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe319761-9c1d-4acc-8bc7-cb5279b9960b service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.773221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] The token cache is being invalidate because project a690708849e041e797981272698a1983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:41.773499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:41.774130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:41.774599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 814/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:41.775802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 825/1639] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:41 2022] DELETE /identity/v3/projects/a690708849e041e797981272698a1983 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:41.776462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4399d8-444b-4d47-b4db-4306ff4ca7e2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.776749 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4399d8-444b-4d47-b4db-4306ff4ca7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.777016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4399d8-444b-4d47-b4db-4306ff4ca7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.779801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.781142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:41.817239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-bb4399d8-444b-4d47-b4db-4306ff4ca7e2 None None] MFA Rules not processed for user `13997f61d7874b1b9f2ac9ac1db4fd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:41.818752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bb4399d8-444b-4d47-b4db-4306ff4ca7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:41.849803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ee332-3924-4c4d-8de2-1a9855d81fdd admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.854624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed584f-fee7-49af-9bee-1dadb6a91f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.855237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed584f-fee7-49af-9bee-1dadb6a91f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.855554 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed584f-fee7-49af-9bee-1dadb6a91f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.855830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed584f-fee7-49af-9bee-1dadb6a91f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.856479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed584f-fee7-49af-9bee-1dadb6a91f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.858067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed584f-fee7-49af-9bee-1dadb6a91f03 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.870193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 826/1640] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:41.871407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed584f-fee7-49af-9bee-1dadb6a91f03 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.873280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-49ed584f-fee7-49af-9bee-1dadb6a91f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:41.885278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed584f-fee7-49af-9bee-1dadb6a91f03 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.888377 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 815/1641] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:41.889683 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911287e5-a24f-4ac1-a216-ac5df1f9eea7 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.890040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911287e5-a24f-4ac1-a216-ac5df1f9eea7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.890249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911287e5-a24f-4ac1-a216-ac5df1f9eea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.890433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32e19c-4cdf-4ecd-bb46-b5b36dabea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.891011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32e19c-4cdf-4ecd-bb46-b5b36dabea06 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.891316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32e19c-4cdf-4ecd-bb46-b5b36dabea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.891589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32e19c-4cdf-4ecd-bb46-b5b36dabea06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.892375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32e19c-4cdf-4ecd-bb46-b5b36dabea06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.894079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32e19c-4cdf-4ecd-bb46-b5b36dabea06 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.908266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 827/1642] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:41.909138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32e19c-4cdf-4ecd-bb46-b5b36dabea06 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.910190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-911287e5-a24f-4ac1-a216-ac5df1f9eea7 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:41.910818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1a32e19c-4cdf-4ecd-bb46-b5b36dabea06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:41.911382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-911287e5-a24f-4ac1-a216-ac5df1f9eea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:41.918686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:41.919699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 816/1643] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:41.920208 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911287e5-a24f-4ac1-a216-ac5df1f9eea7 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.924869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32e19c-4cdf-4ecd-bb46-b5b36dabea06 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.931021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.931863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.932295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.932563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911287e5-a24f-4ac1-a216-ac5df1f9eea7 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:41.932995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] PATH_INFO: `/v3/users/06b7c4fa2b3d47efae32a3ec153a32f4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.934173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b7c4fa2b3d47efae32a3ec153a32f4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.936758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.937966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da3a3-1ad2-43a9-a3b2-ed9a9e28d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:41.938646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da3a3-1ad2-43a9-a3b2-ed9a9e28d594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:41.938924 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da3a3-1ad2-43a9-a3b2-ed9a9e28d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:41.939203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da3a3-1ad2-43a9-a3b2-ed9a9e28d594 admin admin] PATH_INFO: `/v3/projects/7448b64fde8c4fef9fcd79e49d5b0410/users/7f52adaf21f4495fbaf2568882d4e1c7/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:41.955034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7da3a3-1ad2-43a9-a3b2-ed9a9e28d594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7448b64fde8c4fef9fcd79e49d5b0410, user_id=7f52adaf21f4495fbaf2568882d4e1c7, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:41.957710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7da3a3-1ad2-43a9-a3b2-ed9a9e28d594 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:41.971168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 817/1644] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:41 2022] PUT /identity/v3/projects/7448b64fde8c4fef9fcd79e49d5b0410/users/7f52adaf21f4495fbaf2568882d4e1c7/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:41.971778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da3a3-1ad2-43a9-a3b2-ed9a9e28d594 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:41.973361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ac7da3a3-1ad2-43a9-a3b2-ed9a9e28d594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:41.992507 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b7c4fa2b3d47efae32a3ec153a32f4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:41.993175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b7c4fa2b3d47efae32a3ec153a32f4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:42.001572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b7c4fa2b3d47efae32a3ec153a32f4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:42.009641 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b7c4fa2b3d47efae32a3ec153a32f4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:42.010380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b7c4fa2b3d47efae32a3ec153a32f4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:42.032012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 828/1645] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:41 2022] DELETE /identity/v3/users/06b7c4fa2b3d47efae32a3ec153a32f4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:42.036320 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.037708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:42.045889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da3a3-1ad2-43a9-a3b2-ed9a9e28d594 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.099372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:42.109273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107b26d-8aae-4711-9fc6-eb40be65d88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.110058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107b26d-8aae-4711-9fc6-eb40be65d88a admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.110552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107b26d-8aae-4711-9fc6-eb40be65d88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.110818 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107b26d-8aae-4711-9fc6-eb40be65d88a admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.111485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107b26d-8aae-4711-9fc6-eb40be65d88a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.112667 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302f52c-27bc-409e-a736-cd140715f927 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.113366 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107b26d-8aae-4711-9fc6-eb40be65d88a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.117736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a030-0825-4817-92cc-29913928113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.118346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a030-0825-4817-92cc-29913928113e admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.118733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a030-0825-4817-92cc-29913928113e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.119003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a030-0825-4817-92cc-29913928113e admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.119759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a030-0825-4817-92cc-29913928113e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.121341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a030-0825-4817-92cc-29913928113e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.134253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 829/1646] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:42.134253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc336-74ce-42d6-a962-47573a568edd None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.134253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc336-74ce-42d6-a962-47573a568edd None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.134632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc336-74ce-42d6-a962-47573a568edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.151611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 818/1647] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:41 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:42.153219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e386be4-1cb8-492c-8c83-a10e68a2c7d3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.153540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e386be4-1cb8-492c-8c83-a10e68a2c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.153814 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e386be4-1cb8-492c-8c83-a10e68a2c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.162403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-335dc336-74ce-42d6-a962-47573a568edd None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:42.164407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-335dc336-74ce-42d6-a962-47573a568edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:42.190539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1e386be4-1cb8-492c-8c83-a10e68a2c7d3 None None] MFA Rules not processed for user `7f52adaf21f4495fbaf2568882d4e1c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:42.191870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1e386be4-1cb8-492c-8c83-a10e68a2c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:42.248533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 830/1648] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:42.248533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6300b9-f574-48a7-851f-21c78fa6478e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.248533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6300b9-f574-48a7-851f-21c78fa6478e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.248533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6300b9-f574-48a7-851f-21c78fa6478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.268851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fb6300b9-f574-48a7-851f-21c78fa6478e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:42.270042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fb6300b9-f574-48a7-851f-21c78fa6478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:42.279000 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 819/1649] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:42.282496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 831/1650] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:42.283126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e386be4-1cb8-492c-8c83-a10e68a2c7d3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.283208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6300b9-f574-48a7-851f-21c78fa6478e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.283303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fb6300b9-f574-48a7-851f-21c78fa6478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:42.291574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:42.296656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6300b9-f574-48a7-851f-21c78fa6478e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.298817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e386be4-1cb8-492c-8c83-a10e68a2c7d3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.304164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61b0b8-6056-4f31-8ad5-8510dfb72718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.304836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61b0b8-6056-4f31-8ad5-8510dfb72718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.305162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61b0b8-6056-4f31-8ad5-8510dfb72718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.305386 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61b0b8-6056-4f31-8ad5-8510dfb72718 admin admin] PATH_INFO: `/v3/projects/ca1ff16287ed41cebe85c8eef6b054e7/users/6cd621a5e59d4e0fbefb9370f08df5a9/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.305687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e6b7a-0347-473a-bb69-188cdb182347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.306830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e6b7a-0347-473a-bb69-188cdb182347 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.307335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e6b7a-0347-473a-bb69-188cdb182347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.307664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e6b7a-0347-473a-bb69-188cdb182347 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.308397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e6b7a-0347-473a-bb69-188cdb182347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.310815 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e6b7a-0347-473a-bb69-188cdb182347 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.323368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61b0b8-6056-4f31-8ad5-8510dfb72718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1ff16287ed41cebe85c8eef6b054e7, user_id=6cd621a5e59d4e0fbefb9370f08df5a9, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.326468 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61b0b8-6056-4f31-8ad5-8510dfb72718 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.338058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 832/1651] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:42 2022] POST /identity/v3/users => generated 300 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:42.338940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e6b7a-0347-473a-bb69-188cdb182347 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.344677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 820/1652] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:42 2022] PUT /identity/v3/projects/ca1ff16287ed41cebe85c8eef6b054e7/users/6cd621a5e59d4e0fbefb9370f08df5a9/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:42.348558 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61b0b8-6056-4f31-8ad5-8510dfb72718 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.350549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e6b7a-0347-473a-bb69-188cdb182347 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.356383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2a61b0b8-6056-4f31-8ad5-8510dfb72718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:42.419190 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e4363-27f9-4920-8d14-d94c984279f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.419836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e4363-27f9-4920-8d14-d94c984279f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.420116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e4363-27f9-4920-8d14-d94c984279f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.420420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e4363-27f9-4920-8d14-d94c984279f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.421093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e4363-27f9-4920-8d14-d94c984279f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:42.421395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e4363-27f9-4920-8d14-d94c984279f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.423055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e4363-27f9-4920-8d14-d94c984279f0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.435424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 833/1653] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:42.436220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e4363-27f9-4920-8d14-d94c984279f0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.437800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ee7e4363-27f9-4920-8d14-d94c984279f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:42.443900 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61b0b8-6056-4f31-8ad5-8510dfb72718 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.448725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9f96d-3b78-4af1-86ab-ba8cad8d3308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.449337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9f96d-3b78-4af1-86ab-ba8cad8d3308 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.449621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9f96d-3b78-4af1-86ab-ba8cad8d3308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.449897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9f96d-3b78-4af1-86ab-ba8cad8d3308 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.450818 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9f96d-3b78-4af1-86ab-ba8cad8d3308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.452739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9f96d-3b78-4af1-86ab-ba8cad8d3308 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.479362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 821/1654] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:42 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:42.480423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9f96d-3b78-4af1-86ab-ba8cad8d3308 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.499576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e4363-27f9-4920-8d14-d94c984279f0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.514227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:42.549599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ac8ca-5763-41f9-a6e5-aa2005d082bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.550181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ac8ca-5763-41f9-a6e5-aa2005d082bf service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.550463 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ac8ca-5763-41f9-a6e5-aa2005d082bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.550735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ac8ca-5763-41f9-a6e5-aa2005d082bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.551004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9f96d-3b78-4af1-86ab-ba8cad8d3308 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.556048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f699c-d3c0-486b-b84a-a7d2b242e84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.556825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f699c-d3c0-486b-b84a-a7d2b242e84d admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.557173 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f699c-d3c0-486b-b84a-a7d2b242e84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.557597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f699c-d3c0-486b-b84a-a7d2b242e84d admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.558597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f699c-d3c0-486b-b84a-a7d2b242e84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.561294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f699c-d3c0-486b-b84a-a7d2b242e84d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.561456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ac8ca-5763-41f9-a6e5-aa2005d082bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.562896 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ac8ca-5763-41f9-a6e5-aa2005d082bf service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.573847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 834/1655] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:42.575132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9fad-38b6-4ba2-b510-7f26b5ad594f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.575760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9fad-38b6-4ba2-b510-7f26b5ad594f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.576115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9fad-38b6-4ba2-b510-7f26b5ad594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.582003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 822/1656] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:42.583549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f699c-d3c0-486b-b84a-a7d2b242e84d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.599112 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f699c-d3c0-486b-b84a-a7d2b242e84d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.604787 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a8794-8cbe-4fa4-b296-88b0745c5c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.611705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a8794-8cbe-4fa4-b296-88b0745c5c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.615542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a8794-8cbe-4fa4-b296-88b0745c5c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.615811 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7dae9fad-38b6-4ba2-b510-7f26b5ad594f None None] MFA Rules not processed for user `6cd621a5e59d4e0fbefb9370f08df5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:42.615987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a8794-8cbe-4fa4-b296-88b0745c5c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.617050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7dae9fad-38b6-4ba2-b510-7f26b5ad594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:42.617165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a8794-8cbe-4fa4-b296-88b0745c5c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.620132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a8794-8cbe-4fa4-b296-88b0745c5c23 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.656312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:42.662324 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 823/1657] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:42 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:42.664359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a8794-8cbe-4fa4-b296-88b0745c5c23 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.706039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 835/1658] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:42.706039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9fad-38b6-4ba2-b510-7f26b5ad594f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.717562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9fad-38b6-4ba2-b510-7f26b5ad594f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.757371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a8794-8cbe-4fa4-b296-88b0745c5c23 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.764908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447b4a-b853-45be-b69a-1b002fc9b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.765753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447b4a-b853-45be-b69a-1b002fc9b316 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.767150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447b4a-b853-45be-b69a-1b002fc9b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.767610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63447b4a-b853-45be-b69a-1b002fc9b316 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.768673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63447b4a-b853-45be-b69a-1b002fc9b316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.771666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63447b4a-b853-45be-b69a-1b002fc9b316 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.813109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 824/1659] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:42 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:42.813109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447b4a-b853-45be-b69a-1b002fc9b316 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.822323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63447b4a-b853-45be-b69a-1b002fc9b316 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.824400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecca66-eacb-40e2-b831-a9a2aee2ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.825392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecca66-eacb-40e2-b831-a9a2aee2ff0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.825894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecca66-eacb-40e2-b831-a9a2aee2ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.826263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecca66-eacb-40e2-b831-a9a2aee2ff0a admin admin] PATH_INFO: `/v3/projects/ae0a440a863143b78373fa0e4bcfc05e/users/685fcd608b9e42ae9082dcc141172d9f/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.830135 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9599b-0e19-4dd8-bd26-39c16a994ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.830803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9599b-0e19-4dd8-bd26-39c16a994ffb admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.831191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9599b-0e19-4dd8-bd26-39c16a994ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.831611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9599b-0e19-4dd8-bd26-39c16a994ffb admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.832414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9599b-0e19-4dd8-bd26-39c16a994ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.835065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9599b-0e19-4dd8-bd26-39c16a994ffb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.859123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecca66-eacb-40e2-b831-a9a2aee2ff0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0a440a863143b78373fa0e4bcfc05e, user_id=685fcd608b9e42ae9082dcc141172d9f, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.861909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecca66-eacb-40e2-b831-a9a2aee2ff0a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.862360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 825/1660] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:42 2022] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:42.863360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9599b-0e19-4dd8-bd26-39c16a994ffb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.877027 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9599b-0e19-4dd8-bd26-39c16a994ffb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.884262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 836/1661] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:42 2022] PUT /identity/v3/projects/ae0a440a863143b78373fa0e4bcfc05e/users/685fcd608b9e42ae9082dcc141172d9f/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:42.884262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecca66-eacb-40e2-b831-a9a2aee2ff0a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.950108 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406b66f-c7a8-4590-a1cb-35d956f9e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.951184 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406b66f-c7a8-4590-a1cb-35d956f9e39f admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.951943 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406b66f-c7a8-4590-a1cb-35d956f9e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.953310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406b66f-c7a8-4590-a1cb-35d956f9e39f admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.955072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406b66f-c7a8-4590-a1cb-35d956f9e39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.957759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406b66f-c7a8-4590-a1cb-35d956f9e39f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.958660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecca66-eacb-40e2-b831-a9a2aee2ff0a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.963574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce4358-863b-4543-ba15-354fbd1815e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.964189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce4358-863b-4543-ba15-354fbd1815e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.964472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce4358-863b-4543-ba15-354fbd1815e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.964774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce4358-863b-4543-ba15-354fbd1815e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.965420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce4358-863b-4543-ba15-354fbd1815e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.967057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce4358-863b-4543-ba15-354fbd1815e7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:42.977975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 837/1662] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:42.978866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce4358-863b-4543-ba15-354fbd1815e7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.987669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:42.989730 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce4358-863b-4543-ba15-354fbd1815e7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:42.994809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e4a4d-58bb-41e9-aa0d-0466a826e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:42.995411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 826/1663] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:42 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:42.995488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4a4d-58bb-41e9-aa0d-0466a826e89c admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:42.995809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4a4d-58bb-41e9-aa0d-0466a826e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:42.996148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4a4d-58bb-41e9-aa0d-0466a826e89c admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:42.996253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406b66f-c7a8-4590-a1cb-35d956f9e39f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:42.996931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e4a4d-58bb-41e9-aa0d-0466a826e89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:42.998569 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e4a4d-58bb-41e9-aa0d-0466a826e89c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.009827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 838/1664] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:43.010613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e4a4d-58bb-41e9-aa0d-0466a826e89c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.012396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-cd7e4a4d-58bb-41e9-aa0d-0466a826e89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.024915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e4a4d-58bb-41e9-aa0d-0466a826e89c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.064395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:43.066782 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406b66f-c7a8-4590-a1cb-35d956f9e39f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.071492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92755924-e005-483b-a1c7-2c9dceda4782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.072104 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92755924-e005-483b-a1c7-2c9dceda4782 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.072378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92755924-e005-483b-a1c7-2c9dceda4782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.072646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92755924-e005-483b-a1c7-2c9dceda4782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.073280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92755924-e005-483b-a1c7-2c9dceda4782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.074880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92755924-e005-483b-a1c7-2c9dceda4782 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.086104 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 827/1665] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:43.086907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92755924-e005-483b-a1c7-2c9dceda4782 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.089470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.090131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.090407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.090675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] PATH_INFO: `/v3/projects/584cc64b3ee54c7bb6f101d84bf704b4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.091918 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=584cc64b3ee54c7bb6f101d84bf704b4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.093693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.098136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92755924-e005-483b-a1c7-2c9dceda4782 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.102996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cd463-4f10-40e5-ac30-e621f7df9cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.104180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd463-4f10-40e5-ac30-e621f7df9cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.104495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd463-4f10-40e5-ac30-e621f7df9cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.104956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cd463-4f10-40e5-ac30-e621f7df9cd9 admin admin] PATH_INFO: `/v3/projects/9ebeecd4fada4bc4b2de73b6a9f25cea/users/0fb5e899f8334f1b97926d32649aff2f/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.120336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cd463-4f10-40e5-ac30-e621f7df9cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebeecd4fada4bc4b2de73b6a9f25cea, user_id=0fb5e899f8334f1b97926d32649aff2f, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.123183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cd463-4f10-40e5-ac30-e621f7df9cd9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.136270 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 828/1666] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:43 2022] PUT /identity/v3/projects/9ebeecd4fada4bc4b2de73b6a9f25cea/users/0fb5e899f8334f1b97926d32649aff2f/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:43.139244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cd463-4f10-40e5-ac30-e621f7df9cd9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.143802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584cc64b3ee54c7bb6f101d84bf704b4', 'request_id': 'req-851011cf-6fda-4c3c-a599-35e02d124cf1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:43.149274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584cc64b3ee54c7bb6f101d84bf704b4', 'request_id': 'req-851011cf-6fda-4c3c-a599-35e02d124cf1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:43.155581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584cc64b3ee54c7bb6f101d84bf704b4', 'request_id': 'req-851011cf-6fda-4c3c-a599-35e02d124cf1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:43.169060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] The token cache is being invalidate because project 584cc64b3ee54c7bb6f101d84bf704b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:43.169353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:43.169998 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:43.171581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 839/1667] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:43 2022] DELETE /identity/v3/projects/584cc64b3ee54c7bb6f101d84bf704b4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:43.175710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.177029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.199937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cd463-4f10-40e5-ac30-e621f7df9cd9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.205505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840e9d5-4248-4935-bb20-7ce7f36f6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.206113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840e9d5-4248-4935-bb20-7ce7f36f6d9d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.206394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840e9d5-4248-4935-bb20-7ce7f36f6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.206670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840e9d5-4248-4935-bb20-7ce7f36f6d9d admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.207357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840e9d5-4248-4935-bb20-7ce7f36f6d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.209317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840e9d5-4248-4935-bb20-7ce7f36f6d9d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.231310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 829/1668] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:43 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:43.232105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840e9d5-4248-4935-bb20-7ce7f36f6d9d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.233679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4840e9d5-4248-4935-bb20-7ce7f36f6d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.245559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840e9d5-4248-4935-bb20-7ce7f36f6d9d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.246189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851011cf-6fda-4c3c-a599-35e02d124cf1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.250394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612617f-f39f-4e97-8f2e-a17a301483ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.250898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b1ce5-9412-4d1a-94b8-124f865a081b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.251616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612617f-f39f-4e97-8f2e-a17a301483ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.251907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612617f-f39f-4e97-8f2e-a17a301483ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.252040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b1ce5-9412-4d1a-94b8-124f865a081b admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.252180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612617f-f39f-4e97-8f2e-a17a301483ab admin admin] PATH_INFO: `/v3/projects/ae0a440a863143b78373fa0e4bcfc05e/users/685fcd608b9e42ae9082dcc141172d9f/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.252323 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b1ce5-9412-4d1a-94b8-124f865a081b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.252601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b1ce5-9412-4d1a-94b8-124f865a081b admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.253242 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b1ce5-9412-4d1a-94b8-124f865a081b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.254078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612617f-f39f-4e97-8f2e-a17a301483ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0a440a863143b78373fa0e4bcfc05e, user_id=685fcd608b9e42ae9082dcc141172d9f, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.254836 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b1ce5-9412-4d1a-94b8-124f865a081b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.256725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612617f-f39f-4e97-8f2e-a17a301483ab admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.265289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 840/1669] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:43.266176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b1ce5-9412-4d1a-94b8-124f865a081b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.268396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-636b1ce5-9412-4d1a-94b8-124f865a081b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.269260 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 830/1670] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:43 2022] PUT /identity/v3/projects/ae0a440a863143b78373fa0e4bcfc05e/users/685fcd608b9e42ae9082dcc141172d9f/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:43.272600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe3789-3c90-41e7-895d-5aa9bc2cbb1d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.272886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe3789-3c90-41e7-895d-5aa9bc2cbb1d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.273164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe3789-3c90-41e7-895d-5aa9bc2cbb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.281386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b1ce5-9412-4d1a-94b8-124f865a081b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.293577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5cfe3789-3c90-41e7-895d-5aa9bc2cbb1d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:43.294788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5cfe3789-3c90-41e7-895d-5aa9bc2cbb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.344348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925935b-dcb5-4257-b437-5cb2770f8d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.346016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925935b-dcb5-4257-b437-5cb2770f8d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.346692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925935b-dcb5-4257-b437-5cb2770f8d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.348813 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925935b-dcb5-4257-b437-5cb2770f8d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.349661 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925935b-dcb5-4257-b437-5cb2770f8d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.351981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925935b-dcb5-4257-b437-5cb2770f8d6d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.353992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:43.360280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:43.371971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 841/1671] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:43.373184 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925935b-dcb5-4257-b437-5cb2770f8d6d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.373936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 831/1672] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:43.375953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7925935b-dcb5-4257-b437-5cb2770f8d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.376862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe3789-3c90-41e7-895d-5aa9bc2cbb1d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.388650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe3789-3c90-41e7-895d-5aa9bc2cbb1d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.396128 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba91a8-be12-4e95-96a5-6132cba62db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.397234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba91a8-be12-4e95-96a5-6132cba62db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.397234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba91a8-be12-4e95-96a5-6132cba62db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.397382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba91a8-be12-4e95-96a5-6132cba62db5 admin admin] PATH_INFO: `/v3/projects/386d113bdf914b08b9dd679d6efac8cc/users/a8836f28494a471cbf6cbc840c67bdfc/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.404818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925935b-dcb5-4257-b437-5cb2770f8d6d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.411769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b236d9a-5d17-44c5-8dce-1806c255e7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.412535 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b236d9a-5d17-44c5-8dce-1806c255e7ea admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.412995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b236d9a-5d17-44c5-8dce-1806c255e7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.413282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b236d9a-5d17-44c5-8dce-1806c255e7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.414444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b236d9a-5d17-44c5-8dce-1806c255e7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.415399 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba91a8-be12-4e95-96a5-6132cba62db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386d113bdf914b08b9dd679d6efac8cc, user_id=a8836f28494a471cbf6cbc840c67bdfc, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.416205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b236d9a-5d17-44c5-8dce-1806c255e7ea admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.419997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba91a8-be12-4e95-96a5-6132cba62db5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.430962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 842/1673] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:43.432725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381267aa-b659-4773-a968-f4539d06c7ff None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.433025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381267aa-b659-4773-a968-f4539d06c7ff None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.433488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381267aa-b659-4773-a968-f4539d06c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.447088 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 832/1674] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:43 2022] PUT /identity/v3/projects/386d113bdf914b08b9dd679d6efac8cc/users/a8836f28494a471cbf6cbc840c67bdfc/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:43.448234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba91a8-be12-4e95-96a5-6132cba62db5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.476326 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-381267aa-b659-4773-a968-f4539d06c7ff None None] MFA Rules not processed for user `685fcd608b9e42ae9082dcc141172d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:43.477509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-381267aa-b659-4773-a968-f4539d06c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.522103 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba91a8-be12-4e95-96a5-6132cba62db5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.527116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab1dc4-d7cc-4f79-8636-9eb998759241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.527830 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1dc4-d7cc-4f79-8636-9eb998759241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.528113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1dc4-d7cc-4f79-8636-9eb998759241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.528402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1dc4-d7cc-4f79-8636-9eb998759241 admin admin] PATH_INFO: `/v3/projects/9ebeecd4fada4bc4b2de73b6a9f25cea/users/0fb5e899f8334f1b97926d32649aff2f/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.530357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab1dc4-d7cc-4f79-8636-9eb998759241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebeecd4fada4bc4b2de73b6a9f25cea, user_id=0fb5e899f8334f1b97926d32649aff2f, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.533096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab1dc4-d7cc-4f79-8636-9eb998759241 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.544376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 833/1675] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:43 2022] PUT /identity/v3/projects/9ebeecd4fada4bc4b2de73b6a9f25cea/users/0fb5e899f8334f1b97926d32649aff2f/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:43.545804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a44b1-4d7a-4839-875d-e768b5e92839 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.546192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a44b1-4d7a-4839-875d-e768b5e92839 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.546571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a44b1-4d7a-4839-875d-e768b5e92839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.572774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 843/1676] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:43.573694 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-555a44b1-4d7a-4839-875d-e768b5e92839 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:43.574003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381267aa-b659-4773-a968-f4539d06c7ff None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.575142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-555a44b1-4d7a-4839-875d-e768b5e92839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.589618 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381267aa-b659-4773-a968-f4539d06c7ff None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.661649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 834/1677] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:43.663174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a999b-ef79-4417-895b-39f38dd711aa None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.663697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a999b-ef79-4417-895b-39f38dd711aa None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.664162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a999b-ef79-4417-895b-39f38dd711aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.668144 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af553fc2-6637-4530-8ccd-560df8816490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.668408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af553fc2-6637-4530-8ccd-560df8816490 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.668829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af553fc2-6637-4530-8ccd-560df8816490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.669112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af553fc2-6637-4530-8ccd-560df8816490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.669952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af553fc2-6637-4530-8ccd-560df8816490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.671580 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af553fc2-6637-4530-8ccd-560df8816490 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.682947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 844/1678] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:43.684087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f66e62-cc37-45c1-ada3-05dcb5c0cfbc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.684370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f66e62-cc37-45c1-ada3-05dcb5c0cfbc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.684642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f66e62-cc37-45c1-ada3-05dcb5c0cfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.702608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-bb2a999b-ef79-4417-895b-39f38dd711aa None None] MFA Rules not processed for user `a8836f28494a471cbf6cbc840c67bdfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:43.704032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bb2a999b-ef79-4417-895b-39f38dd711aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.717426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-07f66e62-cc37-45c1-ada3-05dcb5c0cfbc None None] MFA Rules not processed for user `0fb5e899f8334f1b97926d32649aff2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:43.718911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-07f66e62-cc37-45c1-ada3-05dcb5c0cfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.767906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:43.794722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:43.794948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 835/1679] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:43.796147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a999b-ef79-4417-895b-39f38dd711aa None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.797612 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bb2a999b-ef79-4417-895b-39f38dd711aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:43.816240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 845/1680] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:43.817248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f66e62-cc37-45c1-ada3-05dcb5c0cfbc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.834733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f66e62-cc37-45c1-ada3-05dcb5c0cfbc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.841261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630b75f-fc02-4612-8140-4c9509b3de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.842336 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630b75f-fc02-4612-8140-4c9509b3de2d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.842807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630b75f-fc02-4612-8140-4c9509b3de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.843160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630b75f-fc02-4612-8140-4c9509b3de2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.843922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630b75f-fc02-4612-8140-4c9509b3de2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:43.844330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630b75f-fc02-4612-8140-4c9509b3de2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.846816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630b75f-fc02-4612-8140-4c9509b3de2d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.865676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 846/1681] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:21:43.866900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630b75f-fc02-4612-8140-4c9509b3de2d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.879588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630b75f-fc02-4612-8140-4c9509b3de2d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.886681 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf426-db64-4c0e-b73d-e7034f323a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.887493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf426-db64-4c0e-b73d-e7034f323a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.887860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf426-db64-4c0e-b73d-e7034f323a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.888226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf426-db64-4c0e-b73d-e7034f323a69 admin admin] PATH_INFO: `/v3/projects/5c438d1011d24a5ba714b98e96588037/users/030ce250ec014187ac2bb3c2e00ae91a/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.891214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a999b-ef79-4417-895b-39f38dd711aa None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:43.900129 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac38434-f331-4226-b61c-31ecc179d5e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:43.901469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac38434-f331-4226-b61c-31ecc179d5e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:43.901762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac38434-f331-4226-b61c-31ecc179d5e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:43.902036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac38434-f331-4226-b61c-31ecc179d5e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:43.909397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cf426-db64-4c0e-b73d-e7034f323a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c438d1011d24a5ba714b98e96588037, user_id=030ce250ec014187ac2bb3c2e00ae91a, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:43.912881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cf426-db64-4c0e-b73d-e7034f323a69 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:43.942146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 847/1682] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:43 2022] PUT /identity/v3/projects/5c438d1011d24a5ba714b98e96588037/users/030ce250ec014187ac2bb3c2e00ae91a/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:43.942146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf426-db64-4c0e-b73d-e7034f323a69 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:43.942146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a73cf426-db64-4c0e-b73d-e7034f323a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:44.017260 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac38434-f331-4226-b61c-31ecc179d5e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.018891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac38434-f331-4226-b61c-31ecc179d5e4 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.065678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 836/1683] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:44.066785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac38434-f331-4226-b61c-31ecc179d5e4 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:44.093149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac38434-f331-4226-b61c-31ecc179d5e4 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.093434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf426-db64-4c0e-b73d-e7034f323a69 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.098894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9018b2-33b8-48cd-853f-da6e03c50181 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec1b2a49264e4e9218b65f9ff114b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:44.099559 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9018b2-33b8-48cd-853f-da6e03c50181 service glance] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.100075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9018b2-33b8-48cd-853f-da6e03c50181 service glance] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.100181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9018b2-33b8-48cd-853f-da6e03c50181 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.200951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9018b2-33b8-48cd-853f-da6e03c50181 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.202401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9018b2-33b8-48cd-853f-da6e03c50181 service glance] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.231481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 848/1684] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:44.231481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b0073-cbba-4d9c-95ea-fb7d4772a456 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.231481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b0073-cbba-4d9c-95ea-fb7d4772a456 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.231481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b0073-cbba-4d9c-95ea-fb7d4772a456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.231735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb8d35-3682-47d2-9297-073454efdfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:44.231735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb8d35-3682-47d2-9297-073454efdfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.231951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb8d35-3682-47d2-9297-073454efdfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.232556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb8d35-3682-47d2-9297-073454efdfd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.240587 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb8d35-3682-47d2-9297-073454efdfd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.249773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb8d35-3682-47d2-9297-073454efdfd3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.273332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-870b0073-cbba-4d9c-95ea-fb7d4772a456 None None] MFA Rules not processed for user `030ce250ec014187ac2bb3c2e00ae91a`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:44.275812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-870b0073-cbba-4d9c-95ea-fb7d4772a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:44.298410 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 837/1685] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:44 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:44.299289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb8d35-3682-47d2-9297-073454efdfd3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:44.303336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0abb8d35-3682-47d2-9297-073454efdfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:44.341851 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:44.346598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:44.381583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb8d35-3682-47d2-9297-073454efdfd3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.382126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 849/1686] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:44.384258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b0073-cbba-4d9c-95ea-fb7d4772a456 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:44.412329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857df0bc-2b40-415f-a39f-be8047a5fa3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:44.412972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857df0bc-2b40-415f-a39f-be8047a5fa3d service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.413252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857df0bc-2b40-415f-a39f-be8047a5fa3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.413527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857df0bc-2b40-415f-a39f-be8047a5fa3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.419988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b0073-cbba-4d9c-95ea-fb7d4772a456 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.495456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857df0bc-2b40-415f-a39f-be8047a5fa3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.497138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857df0bc-2b40-415f-a39f-be8047a5fa3d service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.504715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc8ddf-e661-422b-8479-706b661b1b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:44.505551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc8ddf-e661-422b-8479-706b661b1b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.505835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc8ddf-e661-422b-8479-706b661b1b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.506115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc8ddf-e661-422b-8479-706b661b1b9a admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.507152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc8ddf-e661-422b-8479-706b661b1b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.508863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 838/1687] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:44.509810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857df0bc-2b40-415f-a39f-be8047a5fa3d service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:44.521183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857df0bc-2b40-415f-a39f-be8047a5fa3d service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.524431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc8ddf-e661-422b-8479-706b661b1b9a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.526193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75afec-ba80-4422-8ed5-d70596d16542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:44.526804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75afec-ba80-4422-8ed5-d70596d16542 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.527089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75afec-ba80-4422-8ed5-d70596d16542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.527411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75afec-ba80-4422-8ed5-d70596d16542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.528179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75afec-ba80-4422-8ed5-d70596d16542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.530456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75afec-ba80-4422-8ed5-d70596d16542 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.564547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 850/1688] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:44 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:44.571522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc8ddf-e661-422b-8479-706b661b1b9a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:44.575997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 839/1689] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:44 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:44.580367 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75afec-ba80-4422-8ed5-d70596d16542 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:44.595186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc8ddf-e661-422b-8479-706b661b1b9a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.686663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75afec-ba80-4422-8ed5-d70596d16542 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.687719 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4d88b-e9ee-41fc-b7ee-4c1727e18aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:44.689448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4d88b-e9ee-41fc-b7ee-4c1727e18aad admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.689810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4d88b-e9ee-41fc-b7ee-4c1727e18aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.690379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4d88b-e9ee-41fc-b7ee-4c1727e18aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.691659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4d88b-e9ee-41fc-b7ee-4c1727e18aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.693619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4d88b-e9ee-41fc-b7ee-4c1727e18aad admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.705338 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10697d50-afde-4dc7-ac15-0f965e97f53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:44.705975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10697d50-afde-4dc7-ac15-0f965e97f53a admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.706253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10697d50-afde-4dc7-ac15-0f965e97f53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.706521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10697d50-afde-4dc7-ac15-0f965e97f53a admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.707207 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10697d50-afde-4dc7-ac15-0f965e97f53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.709145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10697d50-afde-4dc7-ac15-0f965e97f53a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.713211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 851/1690] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:44.714267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4d88b-e9ee-41fc-b7ee-4c1727e18aad admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:44.730094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4d88b-e9ee-41fc-b7ee-4c1727e18aad admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.736543 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2f411-5ac6-4eac-8a67-7a2df59878b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:44.738258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2f411-5ac6-4eac-8a67-7a2df59878b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.738551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2f411-5ac6-4eac-8a67-7a2df59878b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.739012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2f411-5ac6-4eac-8a67-7a2df59878b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.740585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2f411-5ac6-4eac-8a67-7a2df59878b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.742988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2f411-5ac6-4eac-8a67-7a2df59878b6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.763442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 852/1691] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:44.767745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 840/1692] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:44 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:44.771346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2f411-5ac6-4eac-8a67-7a2df59878b6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:44.771737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10697d50-afde-4dc7-ac15-0f965e97f53a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:44.784599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2f411-5ac6-4eac-8a67-7a2df59878b6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.792952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10697d50-afde-4dc7-ac15-0f965e97f53a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.795814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f15540-001c-40db-ace3-8e5829b45e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:44.796420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f15540-001c-40db-ace3-8e5829b45e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.796696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f15540-001c-40db-ace3-8e5829b45e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.797329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f15540-001c-40db-ace3-8e5829b45e55 admin admin] PATH_INFO: `/v3/projects/47b35b2420c04696af6cb482bed4f2bc/users/e1ea9ce4229f4004ac24e0c0cac0b1ec/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.805508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0989c23-54b4-4b5c-ace8-ef0d6798c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:44.806151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0989c23-54b4-4b5c-ace8-ef0d6798c6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.806433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0989c23-54b4-4b5c-ace8-ef0d6798c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.808870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0989c23-54b4-4b5c-ace8-ef0d6798c6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.810760 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0989c23-54b4-4b5c-ace8-ef0d6798c6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.815403 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0989c23-54b4-4b5c-ace8-ef0d6798c6b9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.818470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f15540-001c-40db-ace3-8e5829b45e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b35b2420c04696af6cb482bed4f2bc, user_id=e1ea9ce4229f4004ac24e0c0cac0b1ec, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:44.821282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f15540-001c-40db-ace3-8e5829b45e55 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:44.846280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 841/1693] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:21:44.847616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0989c23-54b4-4b5c-ace8-ef0d6798c6b9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:44.858614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 853/1694] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:44 2022] PUT /identity/v3/projects/47b35b2420c04696af6cb482bed4f2bc/users/e1ea9ce4229f4004ac24e0c0cac0b1ec/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:44.862073 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9265a4f-789a-4354-b182-4892b44e2ce1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:44.862555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9265a4f-789a-4354-b182-4892b44e2ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:44.863056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9265a4f-789a-4354-b182-4892b44e2ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:44.872584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0989c23-54b4-4b5c-ace8-ef0d6798c6b9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:44.899256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c9265a4f-789a-4354-b182-4892b44e2ce1 None None] MFA Rules not processed for user `e1ea9ce4229f4004ac24e0c0cac0b1ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:44.902029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c9265a4f-789a-4354-b182-4892b44e2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:44.921021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:44.960008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:45.000599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24110c-6c48-48f6-ae86-e1d34e862ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:45.003964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24110c-6c48-48f6-ae86-e1d34e862ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:45.004244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24110c-6c48-48f6-ae86-e1d34e862ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:45.005820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24110c-6c48-48f6-ae86-e1d34e862ff9 admin admin] PATH_INFO: `/v3/projects/50759b57aea94fafab2fd0ed87246aa5/users/d0ad43d693f84eb194d68168b8356a2c/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:45.034306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24110c-6c48-48f6-ae86-e1d34e862ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50759b57aea94fafab2fd0ed87246aa5, user_id=d0ad43d693f84eb194d68168b8356a2c, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:45.040423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24110c-6c48-48f6-ae86-e1d34e862ff9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:45.072809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 842/1695] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:44 2022] PUT /identity/v3/projects/50759b57aea94fafab2fd0ed87246aa5/users/d0ad43d693f84eb194d68168b8356a2c/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:45.087609 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24110c-6c48-48f6-ae86-e1d34e862ff9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:45.107685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 854/1696] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:45.114011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9265a4f-789a-4354-b182-4892b44e2ce1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:45.151936 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9265a4f-789a-4354-b182-4892b44e2ce1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:45.252499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24110c-6c48-48f6-ae86-e1d34e862ff9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:45.261415 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e260ceb-4967-4a41-bcc1-835545cac072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:45.262096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260ceb-4967-4a41-bcc1-835545cac072 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:45.262481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260ceb-4967-4a41-bcc1-835545cac072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:45.262964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260ceb-4967-4a41-bcc1-835545cac072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:45.263768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e260ceb-4967-4a41-bcc1-835545cac072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:45.265616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e260ceb-4967-4a41-bcc1-835545cac072 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:45.274090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d1144-4a72-43fe-b31d-fe395b3be921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:45.274775 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d1144-4a72-43fe-b31d-fe395b3be921 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:45.275059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d1144-4a72-43fe-b31d-fe395b3be921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:45.275369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d1144-4a72-43fe-b31d-fe395b3be921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:45.275996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d1144-4a72-43fe-b31d-fe395b3be921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:45.277899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d1144-4a72-43fe-b31d-fe395b3be921 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:45.295360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 843/1697] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:21:45.296893 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e260ceb-4967-4a41-bcc1-835545cac072 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:45.321143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e260ceb-4967-4a41-bcc1-835545cac072 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:45.333991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 855/1698] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:45 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:45.336494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f12228-045d-488f-924e-71be98d9f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:45.337446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f12228-045d-488f-924e-71be98d9f11f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:45.337733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f12228-045d-488f-924e-71be98d9f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:45.337847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d1144-4a72-43fe-b31d-fe395b3be921 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:45.338014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f12228-045d-488f-924e-71be98d9f11f admin admin] PATH_INFO: `/v3/projects/50759b57aea94fafab2fd0ed87246aa5/users/d0ad43d693f84eb194d68168b8356a2c/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:45.343250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f12228-045d-488f-924e-71be98d9f11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=50759b57aea94fafab2fd0ed87246aa5, user_id=d0ad43d693f84eb194d68168b8356a2c, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:45.349251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f12228-045d-488f-924e-71be98d9f11f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:45.393056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 844/1699] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:45 2022] PUT /identity/v3/projects/50759b57aea94fafab2fd0ed87246aa5/users/d0ad43d693f84eb194d68168b8356a2c/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:45.403503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4019-c346-42f6-9b53-69871b870cd7 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:45.403770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4019-c346-42f6-9b53-69871b870cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:45.404038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4019-c346-42f6-9b53-69871b870cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:45.494918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-534e4019-c346-42f6-9b53-69871b870cd7 None None] MFA Rules not processed for user `d0ad43d693f84eb194d68168b8356a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:45.496183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-534e4019-c346-42f6-9b53-69871b870cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:45.530978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d1144-4a72-43fe-b31d-fe395b3be921 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:45.613709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 845/1700] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:45.620262 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e4019-c346-42f6-9b53-69871b870cd7 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:45.667576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:45.681260 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:45.687023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3ba15-86bd-4411-ba51-1616a38fc37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:45.688174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ba15-86bd-4411-ba51-1616a38fc37f admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:45.689623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ba15-86bd-4411-ba51-1616a38fc37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:45.690279 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ba15-86bd-4411-ba51-1616a38fc37f admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:45.691472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3ba15-86bd-4411-ba51-1616a38fc37f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:45.696177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3ba15-86bd-4411-ba51-1616a38fc37f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:45.747387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 856/1701] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:45 2022] POST /identity/v3/users => generated 293 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:45.747387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3ba15-86bd-4411-ba51-1616a38fc37f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:45.768256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e4019-c346-42f6-9b53-69871b870cd7 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:45.798897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:45.799944 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:45.801179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:45.801778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] PATH_INFO: `/v3/users/7f52adaf21f4495fbaf2568882d4e1c7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:45.803404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f52adaf21f4495fbaf2568882d4e1c7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:45.805615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:45.871727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3ba15-86bd-4411-ba51-1616a38fc37f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:45.880872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966bfe-40fa-4cfc-b197-3a8768595656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:45.881514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966bfe-40fa-4cfc-b197-3a8768595656 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:45.886977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966bfe-40fa-4cfc-b197-3a8768595656 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:45.887340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966bfe-40fa-4cfc-b197-3a8768595656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:45.908330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966bfe-40fa-4cfc-b197-3a8768595656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:45.910446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f52adaf21f4495fbaf2568882d4e1c7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:45.921907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f52adaf21f4495fbaf2568882d4e1c7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:45.922556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966bfe-40fa-4cfc-b197-3a8768595656 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:45.933433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f52adaf21f4495fbaf2568882d4e1c7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:45.949079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 857/1702] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:45.951739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966bfe-40fa-4cfc-b197-3a8768595656 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:45.951873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f52adaf21f4495fbaf2568882d4e1c7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:45.952565 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f52adaf21f4495fbaf2568882d4e1c7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:45.965324 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 846/1703] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:45 2022] DELETE /identity/v3/users/7f52adaf21f4495fbaf2568882d4e1c7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:45.966310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:45.971021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:45.975073 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966bfe-40fa-4cfc-b197-3a8768595656 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:46.097942 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:46.098947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:46.100221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:46.100506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] PATH_INFO: `/v3/users/13997f61d7874b1b9f2ac9ac1db4fd9c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:46.123459 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13997f61d7874b1b9f2ac9ac1db4fd9c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:46.123459 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:46.125166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d19393-d951-4e9d-a98f-47e72fb9a2cb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:46.140028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b3902-57f1-4471-b6d0-9dd2026a5e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:46.140666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3902-57f1-4471-b6d0-9dd2026a5e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:46.140959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3902-57f1-4471-b6d0-9dd2026a5e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:46.141219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3902-57f1-4471-b6d0-9dd2026a5e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:46.141897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b3902-57f1-4471-b6d0-9dd2026a5e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:46.143693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b3902-57f1-4471-b6d0-9dd2026a5e84 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:46.168355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 847/1704] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:46.170513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd1ac3-5527-4539-96dc-68b2a7ea9438 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:46.172426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd1ac3-5527-4539-96dc-68b2a7ea9438 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:46.174454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd1ac3-5527-4539-96dc-68b2a7ea9438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:46.205470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1fcd1ac3-5527-4539-96dc-68b2a7ea9438 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:46.206951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1fcd1ac3-5527-4539-96dc-68b2a7ea9438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:46.225147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13997f61d7874b1b9f2ac9ac1db4fd9c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:46.227394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13997f61d7874b1b9f2ac9ac1db4fd9c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:46.235988 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 848/1705] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:46.237006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd1ac3-5527-4539-96dc-68b2a7ea9438 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:46.244972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13997f61d7874b1b9f2ac9ac1db4fd9c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:46.259772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd1ac3-5527-4539-96dc-68b2a7ea9438 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:46.265727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13997f61d7874b1b9f2ac9ac1db4fd9c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:46.265888 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7bd4e-df2f-424c-9cb3-fbe619c0b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:46.266569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7bd4e-df2f-424c-9cb3-fbe619c0b611 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:46.266890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7bd4e-df2f-424c-9cb3-fbe619c0b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:46.267164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7bd4e-df2f-424c-9cb3-fbe619c0b611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:46.267763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13997f61d7874b1b9f2ac9ac1db4fd9c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:46.267901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7bd4e-df2f-424c-9cb3-fbe619c0b611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:46.269801 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7bd4e-df2f-424c-9cb3-fbe619c0b611 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:46.286895 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 849/1706] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:46.286895 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7bd4e-df2f-424c-9cb3-fbe619c0b611 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:46.287221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-78b7bd4e-df2f-424c-9cb3-fbe619c0b611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:46.316601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 858/1707] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:45 2022] DELETE /identity/v3/users/13997f61d7874b1b9f2ac9ac1db4fd9c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:46.318509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:46.320870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:46.323909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:46.341924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:46.389175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7bd4e-df2f-424c-9cb3-fbe619c0b611 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:46.420134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a005d2-bc1b-4b2f-aad1-2c228914cb15 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:46.428700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783419f-6dd5-4f2c-8d0e-001a977c1188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:46.429738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783419f-6dd5-4f2c-8d0e-001a977c1188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:46.430214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783419f-6dd5-4f2c-8d0e-001a977c1188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:46.430680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783419f-6dd5-4f2c-8d0e-001a977c1188 admin admin] PATH_INFO: `/v3/projects/07a39d76fe634e78b95af62eb0669ee4/users/11dffa1839384e0a9974375f23cbf8d3/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:46.467218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783419f-6dd5-4f2c-8d0e-001a977c1188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a39d76fe634e78b95af62eb0669ee4, user_id=11dffa1839384e0a9974375f23cbf8d3, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:46.473958 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783419f-6dd5-4f2c-8d0e-001a977c1188 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:46.479423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25089842-3050-4dbb-b929-f6a9dd713aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:46.480672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25089842-3050-4dbb-b929-f6a9dd713aac service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:46.481023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25089842-3050-4dbb-b929-f6a9dd713aac service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:46.481369 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25089842-3050-4dbb-b929-f6a9dd713aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:46.492662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-25089842-3050-4dbb-b929-f6a9dd713aac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:46.507614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 859/1708] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:46 2022] PUT /identity/v3/projects/07a39d76fe634e78b95af62eb0669ee4/users/11dffa1839384e0a9974375f23cbf8d3/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:46.509451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd1ca-7441-40ff-9e47-c3eed45b1b55 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:46.510357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd1ca-7441-40ff-9e47-c3eed45b1b55 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:46.510886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd1ca-7441-40ff-9e47-c3eed45b1b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:46.520967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25089842-3050-4dbb-b929-f6a9dd713aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:46.524068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25089842-3050-4dbb-b929-f6a9dd713aac service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:46.561503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 850/1709] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:46.565627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6db93-c344-4ea9-9a7a-8f8c9ae07d79 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:46.567320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6db93-c344-4ea9-9a7a-8f8c9ae07d79 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:46.567320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6db93-c344-4ea9-9a7a-8f8c9ae07d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:46.578758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d37dd1ca-7441-40ff-9e47-c3eed45b1b55 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:46.583123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d37dd1ca-7441-40ff-9e47-c3eed45b1b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:46.630374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a3e6db93-c344-4ea9-9a7a-8f8c9ae07d79 None None] MFA Rules not processed for user `11dffa1839384e0a9974375f23cbf8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:46.632372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a3e6db93-c344-4ea9-9a7a-8f8c9ae07d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:46.767845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 860/1710] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:46.796136 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd1ca-7441-40ff-9e47-c3eed45b1b55 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:46.803442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 851/1711] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:46.809968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6db93-c344-4ea9-9a7a-8f8c9ae07d79 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:46.829867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6db93-c344-4ea9-9a7a-8f8c9ae07d79 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:46.842438 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63eef-a76f-4ca6-a951-a2b6faca8035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:46.844071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63eef-a76f-4ca6-a951-a2b6faca8035 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:46.847767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63eef-a76f-4ca6-a951-a2b6faca8035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:46.848776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63eef-a76f-4ca6-a951-a2b6faca8035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:46.849549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e63eef-a76f-4ca6-a951-a2b6faca8035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:46.851711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e63eef-a76f-4ca6-a951-a2b6faca8035 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:46.915871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd1ca-7441-40ff-9e47-c3eed45b1b55 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:46.922137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a28d-dce8-452b-9810-c7ecbebdb3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:46.922325 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 852/1712] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:46 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:46.923224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a28d-dce8-452b-9810-c7ecbebdb3ff service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:46.923366 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63eef-a76f-4ca6-a951-a2b6faca8035 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:46.923562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a28d-dce8-452b-9810-c7ecbebdb3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:46.923834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a28d-dce8-452b-9810-c7ecbebdb3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:46.925093 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b3e63eef-a76f-4ca6-a951-a2b6faca8035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:46.939871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a28d-dce8-452b-9810-c7ecbebdb3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:46.941561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a28d-dce8-452b-9810-c7ecbebdb3ff service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:46.963690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 861/1713] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:46.964861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a28d-dce8-452b-9810-c7ecbebdb3ff service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:46.974586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a28d-dce8-452b-9810-c7ecbebdb3ff service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:46.993273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:47.000424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63eef-a76f-4ca6-a951-a2b6faca8035 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:47.008888 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896c903-49b2-42f4-a2eb-c52078604fc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:47.009624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896c903-49b2-42f4-a2eb-c52078604fc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:47.009909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896c903-49b2-42f4-a2eb-c52078604fc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:47.010217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896c903-49b2-42f4-a2eb-c52078604fc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:47.012188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4896c903-49b2-42f4-a2eb-c52078604fc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:47.032926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:47.087289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a338ee-e246-4bca-b9aa-b1ed1c8c555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:47.088072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a338ee-e246-4bca-b9aa-b1ed1c8c555e admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:47.088353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a338ee-e246-4bca-b9aa-b1ed1c8c555e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:47.088627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a338ee-e246-4bca-b9aa-b1ed1c8c555e admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:47.089514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a338ee-e246-4bca-b9aa-b1ed1c8c555e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:47.092641 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a338ee-e246-4bca-b9aa-b1ed1c8c555e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:47.124691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 862/1714] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:46 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:47.125681 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a338ee-e246-4bca-b9aa-b1ed1c8c555e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:47.138333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a338ee-e246-4bca-b9aa-b1ed1c8c555e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:47.141524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896c903-49b2-42f4-a2eb-c52078604fc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:47.146096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57984733-b327-4fd1-ae4d-c79c23b96120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:47.148003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57984733-b327-4fd1-ae4d-c79c23b96120 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:47.148149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896c903-49b2-42f4-a2eb-c52078604fc8 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:47.148327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57984733-b327-4fd1-ae4d-c79c23b96120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:47.148669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57984733-b327-4fd1-ae4d-c79c23b96120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:47.149545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57984733-b327-4fd1-ae4d-c79c23b96120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:47.151369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57984733-b327-4fd1-ae4d-c79c23b96120 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:47.175050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 863/1715] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:47.175458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 853/1716] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:47.179297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57984733-b327-4fd1-ae4d-c79c23b96120 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:47.197770 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57984733-b327-4fd1-ae4d-c79c23b96120 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:47.212646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558d8ba-f0f5-477a-8028-ed14b6347fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:47.214374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558d8ba-f0f5-477a-8028-ed14b6347fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:47.216180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558d8ba-f0f5-477a-8028-ed14b6347fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:47.216802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558d8ba-f0f5-477a-8028-ed14b6347fa4 admin admin] PATH_INFO: `/v3/projects/024e16478487496bacd4059dbebb19a5/users/3b672e376a5b461da597081625132d1f/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:47.279897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558d8ba-f0f5-477a-8028-ed14b6347fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024e16478487496bacd4059dbebb19a5, user_id=3b672e376a5b461da597081625132d1f, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:47.283199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558d8ba-f0f5-477a-8028-ed14b6347fa4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:47.311286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 864/1717] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:47 2022] PUT /identity/v3/projects/024e16478487496bacd4059dbebb19a5/users/3b672e376a5b461da597081625132d1f/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:47.315562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896c903-49b2-42f4-a2eb-c52078604fc8 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:47.334715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896c903-49b2-42f4-a2eb-c52078604fc8 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:47.425370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8615f-a291-43d5-9e41-3b0dfdb55de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:47.426150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8615f-a291-43d5-9e41-3b0dfdb55de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:47.426424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8615f-a291-43d5-9e41-3b0dfdb55de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:47.426763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8615f-a291-43d5-9e41-3b0dfdb55de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:47.427547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8615f-a291-43d5-9e41-3b0dfdb55de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:47.429543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8615f-a291-43d5-9e41-3b0dfdb55de8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:47.436472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558d8ba-f0f5-477a-8028-ed14b6347fa4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:47.438537 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4558d8ba-f0f5-477a-8028-ed14b6347fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:47.442012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 854/1718] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:47.446848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8615f-a291-43d5-9e41-3b0dfdb55de8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:47.464586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558d8ba-f0f5-477a-8028-ed14b6347fa4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:47.471005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8615f-a291-43d5-9e41-3b0dfdb55de8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:47.500099 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:47.500874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:47.501160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:47.501434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] PATH_INFO: `/v3/projects/7448b64fde8c4fef9fcd79e49d5b0410` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:47.509258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7448b64fde8c4fef9fcd79e49d5b0410)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:47.511223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:47.519760 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893cd3d-b4db-498f-b4d0-b6eccb5acd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:47.520522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893cd3d-b4db-498f-b4d0-b6eccb5acd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:47.520712 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893cd3d-b4db-498f-b4d0-b6eccb5acd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:47.520982 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893cd3d-b4db-498f-b4d0-b6eccb5acd36 admin admin] PATH_INFO: `/v3/projects/024e16478487496bacd4059dbebb19a5/users/3b672e376a5b461da597081625132d1f/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:47.525987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893cd3d-b4db-498f-b4d0-b6eccb5acd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024e16478487496bacd4059dbebb19a5, user_id=3b672e376a5b461da597081625132d1f, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:47.528733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893cd3d-b4db-498f-b4d0-b6eccb5acd36 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:47.556016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 855/1719] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:47 2022] PUT /identity/v3/projects/024e16478487496bacd4059dbebb19a5/users/3b672e376a5b461da597081625132d1f/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:47.566055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e51e41-30a4-4c0d-9685-e22b4241e4c5 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:47.566245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e51e41-30a4-4c0d-9685-e22b4241e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:47.566527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e51e41-30a4-4c0d-9685-e22b4241e4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:47.645159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-05e51e41-30a4-4c0d-9685-e22b4241e4c5 None None] MFA Rules not processed for user `3b672e376a5b461da597081625132d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:47.647080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-05e51e41-30a4-4c0d-9685-e22b4241e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:47.675961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7448b64fde8c4fef9fcd79e49d5b0410', 'request_id': 'req-efe44443-25fc-4a85-8379-32bd1171b8f4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.686552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7448b64fde8c4fef9fcd79e49d5b0410', 'request_id': 'req-efe44443-25fc-4a85-8379-32bd1171b8f4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.697462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7448b64fde8c4fef9fcd79e49d5b0410', 'request_id': 'req-efe44443-25fc-4a85-8379-32bd1171b8f4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.737754 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] The token cache is being invalidate because project 7448b64fde8c4fef9fcd79e49d5b0410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:47.738121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.739074 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.744244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 865/1720] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:47 2022] DELETE /identity/v3/projects/7448b64fde8c4fef9fcd79e49d5b0410 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:47.744793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:47.747950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:47.818834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 856/1721] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:47.818834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e51e41-30a4-4c0d-9685-e22b4241e4c5 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:47.822105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-05e51e41-30a4-4c0d-9685-e22b4241e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:47.847084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:47.857972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe44443-25fc-4a85-8379-32bd1171b8f4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:47.863930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:47.865237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:47.865712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:47.866175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] PATH_INFO: `/v3/users/0fb5e899f8334f1b97926d32649aff2f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:47.867924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb5e899f8334f1b97926d32649aff2f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:47.870642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:47.889194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:47.910935 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e51e41-30a4-4c0d-9685-e22b4241e4c5 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:47.921167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:47.921959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:47.922383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:47.922670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] PATH_INFO: `/v3/projects/9d3527e8ee3f47ecb19e04323432e610` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:47.923904 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3527e8ee3f47ecb19e04323432e610)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:47.925918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:47.930146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb5e899f8334f1b97926d32649aff2f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.930932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb5e899f8334f1b97926d32649aff2f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.940693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb5e899f8334f1b97926d32649aff2f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.948648 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb5e899f8334f1b97926d32649aff2f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.949427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb5e899f8334f1b97926d32649aff2f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.977738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3527e8ee3f47ecb19e04323432e610', 'request_id': 'req-558b0e7d-98c5-47e2-a4de-7e81c9712886'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.981254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 866/1722] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:47 2022] DELETE /identity/v3/users/0fb5e899f8334f1b97926d32649aff2f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:47.984156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:47.986338 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3527e8ee3f47ecb19e04323432e610', 'request_id': 'req-558b0e7d-98c5-47e2-a4de-7e81c9712886'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:47.988997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:47.993457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3527e8ee3f47ecb19e04323432e610', 'request_id': 'req-558b0e7d-98c5-47e2-a4de-7e81c9712886'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.007028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] The token cache is being invalidate because project 9d3527e8ee3f47ecb19e04323432e610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:48.007372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.008091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.009828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 857/1723] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:47 2022] DELETE /identity/v3/projects/9d3527e8ee3f47ecb19e04323432e610 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:48.020638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:48.023032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:48.088222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33d66d-99e8-42c4-a02f-d09f1f302620 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:48.094900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a2a9-10ae-4de0-b4b8-2f2d21009a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:48.095718 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a2a9-10ae-4de0-b4b8-2f2d21009a5c service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:48.096246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a2a9-10ae-4de0-b4b8-2f2d21009a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:48.096521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a2a9-10ae-4de0-b4b8-2f2d21009a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:48.099005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8038a2a9-10ae-4de0-b4b8-2f2d21009a5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:48.155981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b0e7d-98c5-47e2-a4de-7e81c9712886 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:48.216529 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038a2a9-10ae-4de0-b4b8-2f2d21009a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:48.217574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038a2a9-10ae-4de0-b4b8-2f2d21009a5c service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:48.228507 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:48.242083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 867/1724] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:48.252965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:48.253879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:48.254213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:48.254498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] PATH_INFO: `/v3/users/685fcd608b9e42ae9082dcc141172d9f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:48.255850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=685fcd608b9e42ae9082dcc141172d9f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:48.258435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:48.348986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685fcd608b9e42ae9082dcc141172d9f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.359887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685fcd608b9e42ae9082dcc141172d9f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.371804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685fcd608b9e42ae9082dcc141172d9f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.388251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685fcd608b9e42ae9082dcc141172d9f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.389137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dddf5af5-3c43-40ee-bc99-71e45b952a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685fcd608b9e42ae9082dcc141172d9f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.404751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 858/1725] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:48 2022] DELETE /identity/v3/users/685fcd608b9e42ae9082dcc141172d9f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:48.465003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a2a9-10ae-4de0-b4b8-2f2d21009a5c service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:48.466718 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8038a2a9-10ae-4de0-b4b8-2f2d21009a5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:48.498450 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a2a9-10ae-4de0-b4b8-2f2d21009a5c service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:48.562167 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:48.589911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:48.590600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:48.590887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:48.591204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] PATH_INFO: `/v3/projects/9ebeecd4fada4bc4b2de73b6a9f25cea` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:48.593922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebeecd4fada4bc4b2de73b6a9f25cea)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:48.596452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:48.733414 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebeecd4fada4bc4b2de73b6a9f25cea', 'request_id': 'req-50d33ae9-5c46-420c-be47-09adc64c8adc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.743828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebeecd4fada4bc4b2de73b6a9f25cea', 'request_id': 'req-50d33ae9-5c46-420c-be47-09adc64c8adc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.759072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebeecd4fada4bc4b2de73b6a9f25cea', 'request_id': 'req-50d33ae9-5c46-420c-be47-09adc64c8adc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.793635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] The token cache is being invalidate because project 9ebeecd4fada4bc4b2de73b6a9f25cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:48.793981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.795353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:48.797235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 868/1726] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:48 2022] DELETE /identity/v3/projects/9ebeecd4fada4bc4b2de73b6a9f25cea => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:48.801859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b1a65-154a-41c4-979f-e6ad574cc81f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:48.802336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b1a65-154a-41c4-979f-e6ad574cc81f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:48.802421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b1a65-154a-41c4-979f-e6ad574cc81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:48.845533 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-546b1a65-154a-41c4-979f-e6ad574cc81f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:48.847812 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-546b1a65-154a-41c4-979f-e6ad574cc81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:48.943298 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:48.943298 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:48.956882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 859/1727] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:48.965898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1386-3dee-453d-8ef8-01695e1e284a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:48.965898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1386-3dee-453d-8ef8-01695e1e284a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:48.965898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1386-3dee-453d-8ef8-01695e1e284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:48.972307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d33ae9-5c46-420c-be47-09adc64c8adc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:48.978961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:48.980005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:48.980452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:48.980805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] PATH_INFO: `/v3/projects/ae0a440a863143b78373fa0e4bcfc05e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:48.982349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0a440a863143b78373fa0e4bcfc05e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:48.984556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:48.988243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5d4c1386-3dee-453d-8ef8-01695e1e284a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:48.989481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5d4c1386-3dee-453d-8ef8-01695e1e284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:48.998539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 860/1728] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:49.002922 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1386-3dee-453d-8ef8-01695e1e284a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.012972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1386-3dee-453d-8ef8-01695e1e284a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.019053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a7364-3801-473d-88ee-25e6af231ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.019872 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a7364-3801-473d-88ee-25e6af231ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.020395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a7364-3801-473d-88ee-25e6af231ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.020658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a7364-3801-473d-88ee-25e6af231ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.021327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a7364-3801-473d-88ee-25e6af231ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:49.021973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a7364-3801-473d-88ee-25e6af231ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.023850 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a7364-3801-473d-88ee-25e6af231ef7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.045792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 861/1729] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:21:49.046868 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a7364-3801-473d-88ee-25e6af231ef7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.060256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a7364-3801-473d-88ee-25e6af231ef7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.070334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0a440a863143b78373fa0e4bcfc05e', 'request_id': 'req-c49daae5-3477-4463-9e90-206dc15acd41'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:49.077744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0a440a863143b78373fa0e4bcfc05e', 'request_id': 'req-c49daae5-3477-4463-9e90-206dc15acd41'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:49.085609 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0a440a863143b78373fa0e4bcfc05e', 'request_id': 'req-c49daae5-3477-4463-9e90-206dc15acd41'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:49.107598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] The token cache is being invalidate because project ae0a440a863143b78373fa0e4bcfc05e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:49.107897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:49.108903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c49daae5-3477-4463-9e90-206dc15acd41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:49.110493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 869/1730] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:48 2022] DELETE /identity/v3/projects/ae0a440a863143b78373fa0e4bcfc05e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:49.111072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:49.116545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effd36-cef2-4d97-be07-adbe7d62d3e2 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.116932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effd36-cef2-4d97-be07-adbe7d62d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.118073 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effd36-cef2-4d97-be07-adbe7d62d3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.126620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe04d0-465a-4ac5-a850-6ee51913d9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.127531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe04d0-465a-4ac5-a850-6ee51913d9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.127774 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe04d0-465a-4ac5-a850-6ee51913d9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.128039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe04d0-465a-4ac5-a850-6ee51913d9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.128670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe04d0-465a-4ac5-a850-6ee51913d9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.130592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe04d0-465a-4ac5-a850-6ee51913d9c5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.138088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d6effd36-cef2-4d97-be07-adbe7d62d3e2 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:49.139321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d6effd36-cef2-4d97-be07-adbe7d62d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:49.148192 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 870/1731] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:49.156468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571090-ae6a-4bbf-8ca0-0be29532623e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.156753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571090-ae6a-4bbf-8ca0-0be29532623e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.157051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571090-ae6a-4bbf-8ca0-0be29532623e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.162714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 862/1732] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:49 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:49.163719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe04d0-465a-4ac5-a850-6ee51913d9c5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.165309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-49fe04d0-465a-4ac5-a850-6ee51913d9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:49.178663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3e571090-ae6a-4bbf-8ca0-0be29532623e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:49.179900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3e571090-ae6a-4bbf-8ca0-0be29532623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:49.231053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:49.233658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe04d0-465a-4ac5-a850-6ee51913d9c5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.238764 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e14ab7-d5d8-42b4-9ae0-ec5d8c7b4efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.239405 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e14ab7-d5d8-42b4-9ae0-ec5d8c7b4efb admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.239796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e14ab7-d5d8-42b4-9ae0-ec5d8c7b4efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.240071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e14ab7-d5d8-42b4-9ae0-ec5d8c7b4efb admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.240733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e14ab7-d5d8-42b4-9ae0-ec5d8c7b4efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.242627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e14ab7-d5d8-42b4-9ae0-ec5d8c7b4efb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.248917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 871/1733] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:49.253847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571090-ae6a-4bbf-8ca0-0be29532623e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.264965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571090-ae6a-4bbf-8ca0-0be29532623e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.265791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 863/1734] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:49 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:21:49.271008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e14ab7-d5d8-42b4-9ae0-ec5d8c7b4efb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.273712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970ec6b-ec72-4753-bf0e-c56e41892b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.274421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970ec6b-ec72-4753-bf0e-c56e41892b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.274702 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970ec6b-ec72-4753-bf0e-c56e41892b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.274976 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970ec6b-ec72-4753-bf0e-c56e41892b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.275662 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970ec6b-ec72-4753-bf0e-c56e41892b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:49.275957 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970ec6b-ec72-4753-bf0e-c56e41892b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.277556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970ec6b-ec72-4753-bf0e-c56e41892b51 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.280741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e14ab7-d5d8-42b4-9ae0-ec5d8c7b4efb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.285495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8936a-04d7-418c-b1a8-4e5c9034ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.286086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8936a-04d7-418c-b1a8-4e5c9034ca18 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.286363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8936a-04d7-418c-b1a8-4e5c9034ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.286870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8936a-04d7-418c-b1a8-4e5c9034ca18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.287331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8936a-04d7-418c-b1a8-4e5c9034ca18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.288906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8936a-04d7-418c-b1a8-4e5c9034ca18 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.290588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 872/1735] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:21:49.294605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970ec6b-ec72-4753-bf0e-c56e41892b51 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.298841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 864/1736] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:21:49.302557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8936a-04d7-418c-b1a8-4e5c9034ca18 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.306918 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970ec6b-ec72-4753-bf0e-c56e41892b51 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.311801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b680a-4d03-4083-a698-b4b4c2260f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.312372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8936a-04d7-418c-b1a8-4e5c9034ca18 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.312491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b680a-4d03-4083-a698-b4b4c2260f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.312663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b680a-4d03-4083-a698-b4b4c2260f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.312935 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b680a-4d03-4083-a698-b4b4c2260f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.314207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b680a-4d03-4083-a698-b4b4c2260f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.316114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b680a-4d03-4083-a698-b4b4c2260f8d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.317553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646936e-75cc-4843-b7b0-5e5a11e41f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.318142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646936e-75cc-4843-b7b0-5e5a11e41f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.318423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646936e-75cc-4843-b7b0-5e5a11e41f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.318699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646936e-75cc-4843-b7b0-5e5a11e41f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.319368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646936e-75cc-4843-b7b0-5e5a11e41f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.320930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646936e-75cc-4843-b7b0-5e5a11e41f68 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.332081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 865/1737] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:21:49.336618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646936e-75cc-4843-b7b0-5e5a11e41f68 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.345572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 873/1738] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:49 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:21:49.346509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646936e-75cc-4843-b7b0-5e5a11e41f68 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.349783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b680a-4d03-4083-a698-b4b4c2260f8d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.407942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a0e9c-c2f1-41de-9a2e-df698cce0204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.409784 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0e9c-c2f1-41de-9a2e-df698cce0204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.409784 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0e9c-c2f1-41de-9a2e-df698cce0204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.409784 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0e9c-c2f1-41de-9a2e-df698cce0204 admin admin] PATH_INFO: `/v3/projects/6c33909a6b4f4e3396ad0c14fe5bc9d6/users/7a9aed298d8748ec9da67897318c8405/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.415734 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b680a-4d03-4083-a698-b4b4c2260f8d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.420998 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda8204-488d-4b2e-b837-dd7ef9d1ae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.421655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda8204-488d-4b2e-b837-dd7ef9d1ae5f admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.421930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda8204-488d-4b2e-b837-dd7ef9d1ae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.422205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda8204-488d-4b2e-b837-dd7ef9d1ae5f admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.422864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda8204-488d-4b2e-b837-dd7ef9d1ae5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.424798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda8204-488d-4b2e-b837-dd7ef9d1ae5f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.426022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a0e9c-c2f1-41de-9a2e-df698cce0204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c33909a6b4f4e3396ad0c14fe5bc9d6, user_id=7a9aed298d8748ec9da67897318c8405, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.428754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a0e9c-c2f1-41de-9a2e-df698cce0204 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.448699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 866/1739] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:49 2022] PUT /identity/v3/projects/6c33909a6b4f4e3396ad0c14fe5bc9d6/users/7a9aed298d8748ec9da67897318c8405/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:49.453329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf98ae-291f-41da-be62-71a0ca9741dc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.453329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf98ae-291f-41da-be62-71a0ca9741dc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.453329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf98ae-291f-41da-be62-71a0ca9741dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.458630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 874/1740] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:49 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:49.463367 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda8204-488d-4b2e-b837-dd7ef9d1ae5f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.474074 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ccbf98ae-291f-41da-be62-71a0ca9741dc None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:49.475290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ccbf98ae-291f-41da-be62-71a0ca9741dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:49.477358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda8204-488d-4b2e-b837-dd7ef9d1ae5f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.505042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:49.563013 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641205b-6bc2-46be-80e3-c776ff9e2f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.567217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641205b-6bc2-46be-80e3-c776ff9e2f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.567521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 867/1741] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:49.567714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641205b-6bc2-46be-80e3-c776ff9e2f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.567714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641205b-6bc2-46be-80e3-c776ff9e2f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.567714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641205b-6bc2-46be-80e3-c776ff9e2f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.568797 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641205b-6bc2-46be-80e3-c776ff9e2f5a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.574434 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf98ae-291f-41da-be62-71a0ca9741dc None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.576105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ccbf98ae-291f-41da-be62-71a0ca9741dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:49.585455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 875/1742] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:49.589448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641205b-6bc2-46be-80e3-c776ff9e2f5a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.600866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641205b-6bc2-46be-80e3-c776ff9e2f5a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.605442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090ef61-d5de-4020-8320-3f7a499615bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.606040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090ef61-d5de-4020-8320-3f7a499615bc admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.606324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090ef61-d5de-4020-8320-3f7a499615bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.606599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090ef61-d5de-4020-8320-3f7a499615bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.607231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090ef61-d5de-4020-8320-3f7a499615bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.609461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090ef61-d5de-4020-8320-3f7a499615bc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.624002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 876/1743] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:49.625191 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090ef61-d5de-4020-8320-3f7a499615bc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.635964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090ef61-d5de-4020-8320-3f7a499615bc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.638214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf98ae-291f-41da-be62-71a0ca9741dc None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.640643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096a2d2-036a-442c-9970-5a5bfa251b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.641284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096a2d2-036a-442c-9970-5a5bfa251b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.641590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096a2d2-036a-442c-9970-5a5bfa251b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.641860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096a2d2-036a-442c-9970-5a5bfa251b45 admin admin] PATH_INFO: `/v3/projects/ba63d67d3e614402931c8b000b5cc4b6/users/f65fd9949ec4455a890a74763fb433f2/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.641957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7d55c-5c3e-48db-815f-96d3be6c6c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.642967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7d55c-5c3e-48db-815f-96d3be6c6c86 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.642967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7d55c-5c3e-48db-815f-96d3be6c6c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.643167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7d55c-5c3e-48db-815f-96d3be6c6c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.653376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7d55c-5c3e-48db-815f-96d3be6c6c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.655086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7d55c-5c3e-48db-815f-96d3be6c6c86 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.657752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096a2d2-036a-442c-9970-5a5bfa251b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba63d67d3e614402931c8b000b5cc4b6, user_id=f65fd9949ec4455a890a74763fb433f2, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.660448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096a2d2-036a-442c-9970-5a5bfa251b45 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.665243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 868/1744] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:49.675252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 877/1745] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:49 2022] PUT /identity/v3/projects/ba63d67d3e614402931c8b000b5cc4b6/users/f65fd9949ec4455a890a74763fb433f2/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:49.686169 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036a608-be4d-45f1-b6fc-97e8e3fae48c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.686455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036a608-be4d-45f1-b6fc-97e8e3fae48c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.686729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036a608-be4d-45f1-b6fc-97e8e3fae48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.717833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a036a608-be4d-45f1-b6fc-97e8e3fae48c None None] MFA Rules not processed for user `f65fd9949ec4455a890a74763fb433f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:49.719042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a036a608-be4d-45f1-b6fc-97e8e3fae48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:49.788846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 869/1746] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:49.792912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096a2d2-036a-442c-9970-5a5bfa251b45 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.810156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:49.900082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096a2d2-036a-442c-9970-5a5bfa251b45 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:49.906390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6ca7a-ec25-4d09-bd2d-b5757317568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:49.907945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6ca7a-ec25-4d09-bd2d-b5757317568c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:49.908362 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6ca7a-ec25-4d09-bd2d-b5757317568c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:49.909000 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6ca7a-ec25-4d09-bd2d-b5757317568c admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:49.909806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6ca7a-ec25-4d09-bd2d-b5757317568c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:49.912899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6ca7a-ec25-4d09-bd2d-b5757317568c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:49.945796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 878/1747] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:49 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:49.950066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036a608-be4d-45f1-b6fc-97e8e3fae48c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:49.969058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036a608-be4d-45f1-b6fc-97e8e3fae48c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:50.071518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:50.079594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6ca7a-ec25-4d09-bd2d-b5757317568c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:50.081471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f2b6ca7a-ec25-4d09-bd2d-b5757317568c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:50.092056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fbad-0de4-47b5-a78d-fb3cd2aeaf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:50.095704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fbad-0de4-47b5-a78d-fb3cd2aeaf00 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.096048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fbad-0de4-47b5-a78d-fb3cd2aeaf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.096421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6fbad-0de4-47b5-a78d-fb3cd2aeaf00 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.100963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6fbad-0de4-47b5-a78d-fb3cd2aeaf00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:50.106663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6fbad-0de4-47b5-a78d-fb3cd2aeaf00 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:50.160658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 870/1748] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:49 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:50.165301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fbad-0de4-47b5-a78d-fb3cd2aeaf00 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:50.178076 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6fbad-0de4-47b5-a78d-fb3cd2aeaf00 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:50.189140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970be6f5-b23b-44cb-92fc-6df9f6bdf253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:50.189785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970be6f5-b23b-44cb-92fc-6df9f6bdf253 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.190301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970be6f5-b23b-44cb-92fc-6df9f6bdf253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.190580 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970be6f5-b23b-44cb-92fc-6df9f6bdf253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.196440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970be6f5-b23b-44cb-92fc-6df9f6bdf253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:50.199392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970be6f5-b23b-44cb-92fc-6df9f6bdf253 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:50.208442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6ca7a-ec25-4d09-bd2d-b5757317568c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:50.216216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eae4c1-0203-4f7d-b203-b2eab51fccdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:50.221059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eae4c1-0203-4f7d-b203-b2eab51fccdb service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.221483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eae4c1-0203-4f7d-b203-b2eab51fccdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.221766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eae4c1-0203-4f7d-b203-b2eab51fccdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.223560 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 871/1749] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:50.237474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f2eae4c1-0203-4f7d-b203-b2eab51fccdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:50.238740 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970be6f5-b23b-44cb-92fc-6df9f6bdf253 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:50.252058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970be6f5-b23b-44cb-92fc-6df9f6bdf253 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:50.259380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63059e-cde8-40c5-87a3-7c92e072ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:50.260049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63059e-cde8-40c5-87a3-7c92e072ce50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.260329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63059e-cde8-40c5-87a3-7c92e072ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.260602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63059e-cde8-40c5-87a3-7c92e072ce50 admin admin] PATH_INFO: `/v3/projects/36fe5c1a196e42a68d7223ec72741f01/users/69a0ffc1d9d444e28361e5ce85869ab2/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.283131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63059e-cde8-40c5-87a3-7c92e072ce50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36fe5c1a196e42a68d7223ec72741f01, user_id=69a0ffc1d9d444e28361e5ce85869ab2, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:50.287584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63059e-cde8-40c5-87a3-7c92e072ce50 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:50.306501 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 872/1750] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:50 2022] PUT /identity/v3/projects/36fe5c1a196e42a68d7223ec72741f01/users/69a0ffc1d9d444e28361e5ce85869ab2/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:50.310595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63059e-cde8-40c5-87a3-7c92e072ce50 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:50.321913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eae4c1-0203-4f7d-b203-b2eab51fccdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:50.324526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eae4c1-0203-4f7d-b203-b2eab51fccdb service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:50.338278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 879/1751] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:50.412241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63059e-cde8-40c5-87a3-7c92e072ce50 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:50.418333 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fd604-877d-4ac8-aa8e-6540c5a5f750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:50.418950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fd604-877d-4ac8-aa8e-6540c5a5f750 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.419226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fd604-877d-4ac8-aa8e-6540c5a5f750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.419524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fd604-877d-4ac8-aa8e-6540c5a5f750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.420179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fd604-877d-4ac8-aa8e-6540c5a5f750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:50.422242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fd604-877d-4ac8-aa8e-6540c5a5f750 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:50.436965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 873/1752] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:50.445186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eae4c1-0203-4f7d-b203-b2eab51fccdb service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:50.467030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eae4c1-0203-4f7d-b203-b2eab51fccdb service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:50.486803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d1053-3694-4aa5-ad32-227c1c1b4ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:50.487528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d1053-3694-4aa5-ad32-227c1c1b4ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.488334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d1053-3694-4aa5-ad32-227c1c1b4ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.491500 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d1053-3694-4aa5-ad32-227c1c1b4ae4 admin admin] PATH_INFO: `/v3/projects/36fe5c1a196e42a68d7223ec72741f01/users/69a0ffc1d9d444e28361e5ce85869ab2/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.494816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d1053-3694-4aa5-ad32-227c1c1b4ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36fe5c1a196e42a68d7223ec72741f01, user_id=69a0ffc1d9d444e28361e5ce85869ab2, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:50.505193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d1053-3694-4aa5-ad32-227c1c1b4ae4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:50.530030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 880/1753] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:50 2022] PUT /identity/v3/projects/36fe5c1a196e42a68d7223ec72741f01/users/69a0ffc1d9d444e28361e5ce85869ab2/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:50.541592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf407c-a583-4a69-95d5-b87ee963adfe None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.541878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf407c-a583-4a69-95d5-b87ee963adfe None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.542634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf407c-a583-4a69-95d5-b87ee963adfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.585015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6884ee3-8c54-4a77-9440-29f08c9b4b43 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.585373 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6884ee3-8c54-4a77-9440-29f08c9b4b43 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.585721 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6884ee3-8c54-4a77-9440-29f08c9b4b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.601098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3abf407c-a583-4a69-95d5-b87ee963adfe None None] MFA Rules not processed for user `69a0ffc1d9d444e28361e5ce85869ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:50.604599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3abf407c-a583-4a69-95d5-b87ee963adfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:50.633874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d6884ee3-8c54-4a77-9440-29f08c9b4b43 None None] MFA Rules not processed for user `7a9aed298d8748ec9da67897318c8405`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:50.635305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d6884ee3-8c54-4a77-9440-29f08c9b4b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:50.666616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:50.727316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 874/1754] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:50.741491 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf407c-a583-4a69-95d5-b87ee963adfe None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:50.744036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3abf407c-a583-4a69-95d5-b87ee963adfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:50.779307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 881/1755] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:50.784906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6884ee3-8c54-4a77-9440-29f08c9b4b43 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:50.812701 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:50.874516 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf407c-a583-4a69-95d5-b87ee963adfe None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:50.877385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6884ee3-8c54-4a77-9440-29f08c9b4b43 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:50.879499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd41f31-ea6e-4945-9fb0-0af4525222ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:50.880316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41f31-ea6e-4945-9fb0-0af4525222ad service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.880882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41f31-ea6e-4945-9fb0-0af4525222ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.881341 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41f31-ea6e-4945-9fb0-0af4525222ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.882375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebf444-d92f-4160-b170-cf16342619c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:50.882993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf444-d92f-4160-b170-cf16342619c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.883298 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf444-d92f-4160-b170-cf16342619c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.883605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebf444-d92f-4160-b170-cf16342619c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.884251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebf444-d92f-4160-b170-cf16342619c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:50.886170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebf444-d92f-4160-b170-cf16342619c0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:50.916545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 882/1756] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:50 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:21:50.921016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebf444-d92f-4160-b170-cf16342619c0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:50.945021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd41f31-ea6e-4945-9fb0-0af4525222ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:50.946466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd41f31-ea6e-4945-9fb0-0af4525222ad service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:50.956307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 875/1757] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:50.985341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebf444-d92f-4160-b170-cf16342619c0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:50.990070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f67d8-c806-46e4-9d6d-e6770b139bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:50.990672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f67d8-c806-46e4-9d6d-e6770b139bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:50.990946 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f67d8-c806-46e4-9d6d-e6770b139bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:50.991300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f67d8-c806-46e4-9d6d-e6770b139bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:50.991966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f67d8-c806-46e4-9d6d-e6770b139bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:50.993950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f67d8-c806-46e4-9d6d-e6770b139bd6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:51.024284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 883/1758] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:50 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:21:51.028270 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd41f31-ea6e-4945-9fb0-0af4525222ad service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:51.052591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd41f31-ea6e-4945-9fb0-0af4525222ad service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:51.058277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693710-9249-4ded-9dcf-baea6704bbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:51.058947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693710-9249-4ded-9dcf-baea6704bbfc admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:51.059367 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693710-9249-4ded-9dcf-baea6704bbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:51.059632 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693710-9249-4ded-9dcf-baea6704bbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:51.060296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa693710-9249-4ded-9dcf-baea6704bbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:51.062072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa693710-9249-4ded-9dcf-baea6704bbfc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:51.077998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 876/1759] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:51.079615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f67d8-c806-46e4-9d6d-e6770b139bd6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:51.092431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f67d8-c806-46e4-9d6d-e6770b139bd6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:51.098053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41113c-f006-4d33-872f-4e138ffc077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:51.098696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41113c-f006-4d33-872f-4e138ffc077b admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:51.099007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41113c-f006-4d33-872f-4e138ffc077b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:51.099259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41113c-f006-4d33-872f-4e138ffc077b admin admin] PATH_INFO: `/v3/projects/052d481100ce4349af6a02a21468654b/users/e72e61a774034ccabf5337a76841ce1f/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:51.115499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41113c-f006-4d33-872f-4e138ffc077b admin admin] RBAC: Authorizing `identity:create_grant(project_id=052d481100ce4349af6a02a21468654b, user_id=e72e61a774034ccabf5337a76841ce1f, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:51.118171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41113c-f006-4d33-872f-4e138ffc077b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:51.135006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 884/1760] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:51 2022] PUT /identity/v3/projects/052d481100ce4349af6a02a21468654b/users/e72e61a774034ccabf5337a76841ce1f/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:51.136256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693710-9249-4ded-9dcf-baea6704bbfc admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:51.146747 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693710-9249-4ded-9dcf-baea6704bbfc admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:51.236914 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10564f-3087-4728-b4fb-752d88a473f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:51.238023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10564f-3087-4728-b4fb-752d88a473f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:51.238482 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10564f-3087-4728-b4fb-752d88a473f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:51.238996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10564f-3087-4728-b4fb-752d88a473f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:51.239945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10564f-3087-4728-b4fb-752d88a473f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:51.242187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10564f-3087-4728-b4fb-752d88a473f1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:51.256328 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 877/1761] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:51.260252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41113c-f006-4d33-872f-4e138ffc077b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:51.279535 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41113c-f006-4d33-872f-4e138ffc077b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:51.289663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf615e-efc3-4159-a660-cb9dee037069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:51.290481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf615e-efc3-4159-a660-cb9dee037069 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:51.290767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf615e-efc3-4159-a660-cb9dee037069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:51.291452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf615e-efc3-4159-a660-cb9dee037069 admin admin] PATH_INFO: `/v3/projects/052d481100ce4349af6a02a21468654b/users/e72e61a774034ccabf5337a76841ce1f/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:51.294066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf615e-efc3-4159-a660-cb9dee037069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=052d481100ce4349af6a02a21468654b, user_id=e72e61a774034ccabf5337a76841ce1f, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:51.298394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf615e-efc3-4159-a660-cb9dee037069 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:51.315571 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:51.322817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 885/1762] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:21:51 2022] PUT /identity/v3/projects/052d481100ce4349af6a02a21468654b/users/e72e61a774034ccabf5337a76841ce1f/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:51.436494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10564f-3087-4728-b4fb-752d88a473f1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:51.550332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10564f-3087-4728-b4fb-752d88a473f1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:51.590481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:51.642679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003294f-4c44-49ec-b931-dd9accdf0822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:51.656212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003294f-4c44-49ec-b931-dd9accdf0822 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:51.656212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003294f-4c44-49ec-b931-dd9accdf0822 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:51.656212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003294f-4c44-49ec-b931-dd9accdf0822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:51.658508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9003294f-4c44-49ec-b931-dd9accdf0822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:51.787407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003294f-4c44-49ec-b931-dd9accdf0822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:51.789086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003294f-4c44-49ec-b931-dd9accdf0822 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:51.802985 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 878/1763] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:51.903351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf615e-efc3-4159-a660-cb9dee037069 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:51.918451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf615e-efc3-4159-a660-cb9dee037069 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:51.927937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8794aa-cc38-488c-a133-5c986f76b725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:51.928572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8794aa-cc38-488c-a133-5c986f76b725 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:51.928847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8794aa-cc38-488c-a133-5c986f76b725 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:51.929116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8794aa-cc38-488c-a133-5c986f76b725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:51.935583 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8c8794aa-cc38-488c-a133-5c986f76b725 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:52.060678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8794aa-cc38-488c-a133-5c986f76b725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:52.062258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8794aa-cc38-488c-a133-5c986f76b725 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:52.085545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 886/1764] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:52.471341 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07b20-b85d-44e7-8cf3-5aebca3259c4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:52.471866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07b20-b85d-44e7-8cf3-5aebca3259c4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:52.471866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07b20-b85d-44e7-8cf3-5aebca3259c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:52.517117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2db07b20-b85d-44e7-8cf3-5aebca3259c4 None None] MFA Rules not processed for user `e72e61a774034ccabf5337a76841ce1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:52.518872 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2db07b20-b85d-44e7-8cf3-5aebca3259c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:52.673828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 879/1765] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:52.685497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488beca0-111e-4910-b7f6-c147cc1a2a37 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:52.685950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488beca0-111e-4910-b7f6-c147cc1a2a37 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:52.687488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488beca0-111e-4910-b7f6-c147cc1a2a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:52.710132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-488beca0-111e-4910-b7f6-c147cc1a2a37 None None] MFA Rules not processed for user `7a9aed298d8748ec9da67897318c8405`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:52.711533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-488beca0-111e-4910-b7f6-c147cc1a2a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:52.847133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 887/1766] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:52.855219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db07b20-b85d-44e7-8cf3-5aebca3259c4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:52.856898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2db07b20-b85d-44e7-8cf3-5aebca3259c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:52.931890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:52.950095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db07b20-b85d-44e7-8cf3-5aebca3259c4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:52.956699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805638eb-bd04-49a3-aaa2-601d346850d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:52.957585 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805638eb-bd04-49a3-aaa2-601d346850d1 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:52.958039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805638eb-bd04-49a3-aaa2-601d346850d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:52.958445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805638eb-bd04-49a3-aaa2-601d346850d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:52.974864 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805638eb-bd04-49a3-aaa2-601d346850d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:52.979828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805638eb-bd04-49a3-aaa2-601d346850d1 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:52.991926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 880/1767] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:54.768247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488beca0-111e-4910-b7f6-c147cc1a2a37 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:54.769636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-488beca0-111e-4910-b7f6-c147cc1a2a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:54.858082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488beca0-111e-4910-b7f6-c147cc1a2a37 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:54.863986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:54.864633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:54.864912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:54.865188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] PATH_INFO: `/v3/users/6cd621a5e59d4e0fbefb9370f08df5a9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:54.866321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd621a5e59d4e0fbefb9370f08df5a9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:54.868287 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:54.921768 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:54.924853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd621a5e59d4e0fbefb9370f08df5a9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:54.925655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd621a5e59d4e0fbefb9370f08df5a9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:54.951898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd621a5e59d4e0fbefb9370f08df5a9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:54.951898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd621a5e59d4e0fbefb9370f08df5a9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:54.951898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd621a5e59d4e0fbefb9370f08df5a9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:54.978728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 888/1768] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:54 2022] DELETE /identity/v3/users/6cd621a5e59d4e0fbefb9370f08df5a9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:54.983532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be3a33-b1ca-45b8-8181-f9621d1ee731 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:54.983971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be3a33-b1ca-45b8-8181-f9621d1ee731 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:54.984123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be3a33-b1ca-45b8-8181-f9621d1ee731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:55.009319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c6be3a33-b1ca-45b8-8181-f9621d1ee731 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:55.010484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c6be3a33-b1ca-45b8-8181-f9621d1ee731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:55.085130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 881/1769] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:55.099889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:55.102081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:55.181551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa440513-9abd-4ea4-aa5b-b7fcef61b278 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:55.186075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741834a3-7517-43e8-ba3e-af867f82d301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:55.186710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741834a3-7517-43e8-ba3e-af867f82d301 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:55.187035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741834a3-7517-43e8-ba3e-af867f82d301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:55.187399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741834a3-7517-43e8-ba3e-af867f82d301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:55.206429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741834a3-7517-43e8-ba3e-af867f82d301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:55.209189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741834a3-7517-43e8-ba3e-af867f82d301 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:55.231295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 889/1770] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:21:55.820370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be3a33-b1ca-45b8-8181-f9621d1ee731 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:55.822491 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c6be3a33-b1ca-45b8-8181-f9621d1ee731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:55.904638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be3a33-b1ca-45b8-8181-f9621d1ee731 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:55.909583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b9388-ed59-43f2-b452-507cef3049e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:55.910300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b9388-ed59-43f2-b452-507cef3049e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:55.910648 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b9388-ed59-43f2-b452-507cef3049e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:55.910994 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b9388-ed59-43f2-b452-507cef3049e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:55.913560 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-397b9388-ed59-43f2-b452-507cef3049e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:56.006301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b9388-ed59-43f2-b452-507cef3049e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:56.008984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b9388-ed59-43f2-b452-507cef3049e2 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:56.021624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 882/1771] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:56.228329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741834a3-7517-43e8-ba3e-af867f82d301 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:56.229914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-741834a3-7517-43e8-ba3e-af867f82d301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:56.254487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741834a3-7517-43e8-ba3e-af867f82d301 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:56.270588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:56.272176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:56.274682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:56.275057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] PATH_INFO: `/v3/users/e1ea9ce4229f4004ac24e0c0cac0b1ec` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:56.284268 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ea9ce4229f4004ac24e0c0cac0b1ec)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:56.284268 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:56.381711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b9388-ed59-43f2-b452-507cef3049e2 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:56.383369 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-397b9388-ed59-43f2-b452-507cef3049e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:56.391022 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ea9ce4229f4004ac24e0c0cac0b1ec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.391985 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ea9ce4229f4004ac24e0c0cac0b1ec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.412183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ea9ce4229f4004ac24e0c0cac0b1ec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.417689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b9388-ed59-43f2-b452-507cef3049e2 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:56.425201 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:56.427021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:56.427486 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:56.428666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] PATH_INFO: `/v3/projects/ca1ff16287ed41cebe85c8eef6b054e7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:56.431882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1ff16287ed41cebe85c8eef6b054e7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:56.435418 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:56.440330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ea9ce4229f4004ac24e0c0cac0b1ec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.441146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c7f46a4f-0ab7-4aed-b2b3-a5886b401f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ea9ce4229f4004ac24e0c0cac0b1ec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.481122 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 890/1772] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:56 2022] DELETE /identity/v3/users/e1ea9ce4229f4004ac24e0c0cac0b1ec => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:56.488776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab24a8-6b03-478f-9561-34aa209ef1ff None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:56.489227 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab24a8-6b03-478f-9561-34aa209ef1ff None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:56.489613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab24a8-6b03-478f-9561-34aa209ef1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:56.520466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:56.537893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-03ab24a8-6b03-478f-9561-34aa209ef1ff None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:56.541168 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-03ab24a8-6b03-478f-9561-34aa209ef1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:56.553223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1ff16287ed41cebe85c8eef6b054e7', 'request_id': 'req-98b86d52-d876-440c-8fcd-65ca67d42cc6'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.568422 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1ff16287ed41cebe85c8eef6b054e7', 'request_id': 'req-98b86d52-d876-440c-8fcd-65ca67d42cc6'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.580497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1ff16287ed41cebe85c8eef6b054e7', 'request_id': 'req-98b86d52-d876-440c-8fcd-65ca67d42cc6'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.604239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] The token cache is being invalidate because project ca1ff16287ed41cebe85c8eef6b054e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:56.604542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.606606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.613045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 883/1773] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:56 2022] DELETE /identity/v3/projects/ca1ff16287ed41cebe85c8eef6b054e7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:56.614109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:56.615548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:56.618062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:56.692630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 891/1774] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:21:56.706114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab24a8-6b03-478f-9561-34aa209ef1ff None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:56.708241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-03ab24a8-6b03-478f-9561-34aa209ef1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:56.720263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b86d52-d876-440c-8fcd-65ca67d42cc6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:56.725979 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:56.726638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:56.726914 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:56.727248 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] PATH_INFO: `/v3/users/030ce250ec014187ac2bb3c2e00ae91a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:56.728513 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] RBAC: Authorizing `identity:delete_user(user_id=030ce250ec014187ac2bb3c2e00ae91a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:56.730453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:56.783144 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab24a8-6b03-478f-9561-34aa209ef1ff None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:56.788693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e9e50-6fd6-4eda-9a9a-fbe1ed083288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:56.789406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e9e50-6fd6-4eda-9a9a-fbe1ed083288 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:56.789797 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e9e50-6fd6-4eda-9a9a-fbe1ed083288 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:56.790067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e9e50-6fd6-4eda-9a9a-fbe1ed083288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:56.801718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030ce250ec014187ac2bb3c2e00ae91a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.804345 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e9e50-6fd6-4eda-9a9a-fbe1ed083288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:56.806839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e9e50-6fd6-4eda-9a9a-fbe1ed083288 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:56.811781 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030ce250ec014187ac2bb3c2e00ae91a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.821830 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030ce250ec014187ac2bb3c2e00ae91a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.822906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 892/1775] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:21:56.837679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030ce250ec014187ac2bb3c2e00ae91a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.838577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030ce250ec014187ac2bb3c2e00ae91a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:56.847175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 884/1776] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:56 2022] DELETE /identity/v3/users/030ce250ec014187ac2bb3c2e00ae91a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:57.585751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e9e50-6fd6-4eda-9a9a-fbe1ed083288 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:57.608035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e9e50-6fd6-4eda-9a9a-fbe1ed083288 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:57.729733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:57.730400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:57.730798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:57.730945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] PATH_INFO: `/v3/projects/5c438d1011d24a5ba714b98e96588037` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:57.733040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c438d1011d24a5ba714b98e96588037)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:57.735033 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:57.818121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c438d1011d24a5ba714b98e96588037', 'request_id': 'req-a7924193-a600-4997-90a9-52af9f19d7d6'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:57.825865 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c438d1011d24a5ba714b98e96588037', 'request_id': 'req-a7924193-a600-4997-90a9-52af9f19d7d6'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:57.842884 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c438d1011d24a5ba714b98e96588037', 'request_id': 'req-a7924193-a600-4997-90a9-52af9f19d7d6'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:57.885491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] The token cache is being invalidate because project 5c438d1011d24a5ba714b98e96588037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:57.885491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:57.886664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:57.895584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:57.896364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 893/1777] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:57 2022] DELETE /identity/v3/projects/5c438d1011d24a5ba714b98e96588037 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:57.897479 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:57.916932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b3fd9-ea61-42e8-8d5c-d6411ede10de admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:57.940828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:57.942320 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:57.972670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:58.007470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:58.051390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:58.053633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:58.053859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:58.054142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] PATH_INFO: `/v3/users/d0ad43d693f84eb194d68168b8356a2c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:58.056370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ad43d693f84eb194d68168b8356a2c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:58.062034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:58.093696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7924193-a600-4997-90a9-52af9f19d7d6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:58.106631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:58.107123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:58.107429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:58.107701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] PATH_INFO: `/v3/projects/47b35b2420c04696af6cb482bed4f2bc` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:58.111090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b35b2420c04696af6cb482bed4f2bc)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:58.117272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:58.179532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ad43d693f84eb194d68168b8356a2c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.199099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ad43d693f84eb194d68168b8356a2c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.207746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b35b2420c04696af6cb482bed4f2bc', 'request_id': 'req-b4128e8d-16ce-4f09-b510-27fba4bc174e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.215088 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ad43d693f84eb194d68168b8356a2c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.216569 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b35b2420c04696af6cb482bed4f2bc', 'request_id': 'req-b4128e8d-16ce-4f09-b510-27fba4bc174e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.228609 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b35b2420c04696af6cb482bed4f2bc', 'request_id': 'req-b4128e8d-16ce-4f09-b510-27fba4bc174e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.242686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] The token cache is being invalidate because project 47b35b2420c04696af6cb482bed4f2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:58.243243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.244492 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.249499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 894/1778] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:57 2022] DELETE /identity/v3/projects/47b35b2420c04696af6cb482bed4f2bc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:58.250747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:58.253043 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:58.255121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ad43d693f84eb194d68168b8356a2c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.256082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ad43d693f84eb194d68168b8356a2c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.277060 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 885/1779] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:57 2022] DELETE /identity/v3/users/d0ad43d693f84eb194d68168b8356a2c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:58.372343 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4128e8d-16ce-4f09-b510-27fba4bc174e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:58.445604 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:58.472930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:58.473684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:58.474110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:58.474948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] PATH_INFO: `/v3/users/11dffa1839384e0a9974375f23cbf8d3` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:58.476354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=11dffa1839384e0a9974375f23cbf8d3)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:58.481941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:58.585247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11dffa1839384e0a9974375f23cbf8d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.586580 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11dffa1839384e0a9974375f23cbf8d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.609125 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11dffa1839384e0a9974375f23cbf8d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.619840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11dffa1839384e0a9974375f23cbf8d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.620638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a629496c-f92a-45bd-a925-fe089feac6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11dffa1839384e0a9974375f23cbf8d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:58.667186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 895/1780] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:58 2022] DELETE /identity/v3/users/11dffa1839384e0a9974375f23cbf8d3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:58.861959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:58.863557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:58.901766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e4943-a612-454e-86f5-ffeed480e0e4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:59.045920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:59.046622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:59.046992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:59.047312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] PATH_INFO: `/v3/projects/50759b57aea94fafab2fd0ed87246aa5` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:59.054280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50759b57aea94fafab2fd0ed87246aa5)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:59.056725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:59.148457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50759b57aea94fafab2fd0ed87246aa5', 'request_id': 'req-c2fc8292-79d2-42a4-976d-5196c3ff183c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:59.165043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50759b57aea94fafab2fd0ed87246aa5', 'request_id': 'req-c2fc8292-79d2-42a4-976d-5196c3ff183c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:59.172326 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:59.179316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50759b57aea94fafab2fd0ed87246aa5', 'request_id': 'req-c2fc8292-79d2-42a4-976d-5196c3ff183c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:59.206326 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] The token cache is being invalidate because project 50759b57aea94fafab2fd0ed87246aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:59.206631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:59.208517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2fc8292-79d2-42a4-976d-5196c3ff183c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:59.218771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 886/1781] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:58 2022] DELETE /identity/v3/projects/50759b57aea94fafab2fd0ed87246aa5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:21:59.221274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48acfe8-04f3-40dd-ade7-b8f26a4b107d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:59.221618 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48acfe8-04f3-40dd-ade7-b8f26a4b107d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:59.221830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48acfe8-04f3-40dd-ade7-b8f26a4b107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:59.281222 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b48acfe8-04f3-40dd-ade7-b8f26a4b107d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:59.286570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b48acfe8-04f3-40dd-ade7-b8f26a4b107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:59.463988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 896/1782] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:59.473151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe3983-2aeb-4d2b-9fe6-23885b4713db None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:59.473431 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe3983-2aeb-4d2b-9fe6-23885b4713db None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:59.473708 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe3983-2aeb-4d2b-9fe6-23885b4713db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:59.506678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-66fe3983-2aeb-4d2b-9fe6-23885b4713db None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:21:59.508917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-66fe3983-2aeb-4d2b-9fe6-23885b4713db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:59.522269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 887/1783] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:21:59.523011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48acfe8-04f3-40dd-ade7-b8f26a4b107d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:59.534384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48acfe8-04f3-40dd-ade7-b8f26a4b107d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:59.542553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9821ad-4eaa-436d-8f0c-1c139e53db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:59.543909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9821ad-4eaa-436d-8f0c-1c139e53db7d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:59.544196 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9821ad-4eaa-436d-8f0c-1c139e53db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:59.544480 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9821ad-4eaa-436d-8f0c-1c139e53db7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:59.545156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9821ad-4eaa-436d-8f0c-1c139e53db7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:21:59.545464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9821ad-4eaa-436d-8f0c-1c139e53db7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:59.548735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9821ad-4eaa-436d-8f0c-1c139e53db7d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:59.573636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 897/1784] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:21:59.575396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe3983-2aeb-4d2b-9fe6-23885b4713db None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:59.587143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe3983-2aeb-4d2b-9fe6-23885b4713db None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:59.593747 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62220e29-44e5-4021-8105-36fbb5d5ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:59.595375 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62220e29-44e5-4021-8105-36fbb5d5ef2e admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:59.595933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62220e29-44e5-4021-8105-36fbb5d5ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:59.596357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62220e29-44e5-4021-8105-36fbb5d5ef2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:59.597140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62220e29-44e5-4021-8105-36fbb5d5ef2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:59.599480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62220e29-44e5-4021-8105-36fbb5d5ef2e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:59.634716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 888/1785] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:21:59 2022] POST /identity/v3/projects => generated 401 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:59.635818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9821ad-4eaa-436d-8f0c-1c139e53db7d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:59.647130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9821ad-4eaa-436d-8f0c-1c139e53db7d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:59.713855 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:21:59.726788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062761cd-81ed-4d2c-be96-34f4e3094f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:59.727683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062761cd-81ed-4d2c-be96-34f4e3094f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:59.728138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062761cd-81ed-4d2c-be96-34f4e3094f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:59.728423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062761cd-81ed-4d2c-be96-34f4e3094f8f admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:59.729282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062761cd-81ed-4d2c-be96-34f4e3094f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:59.732047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062761cd-81ed-4d2c-be96-34f4e3094f8f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:59.746656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62220e29-44e5-4021-8105-36fbb5d5ef2e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:59.749357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-62220e29-44e5-4021-8105-36fbb5d5ef2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:59.770863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62220e29-44e5-4021-8105-36fbb5d5ef2e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:59.775854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:59.776797 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 898/1786] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:21:59 2022] POST /identity/v3/users => generated 301 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:21:59.779732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:59.780001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:59.780292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] PATH_INFO: `/v3/projects/07a39d76fe634e78b95af62eb0669ee4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:59.781360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062761cd-81ed-4d2c-be96-34f4e3094f8f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:59.781546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a39d76fe634e78b95af62eb0669ee4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:59.783635 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:59.795074 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062761cd-81ed-4d2c-be96-34f4e3094f8f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:59.802405 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d8532-4324-4940-8b94-a72a5b03037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:59.803861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d8532-4324-4940-8b94-a72a5b03037e admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:59.804733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d8532-4324-4940-8b94-a72a5b03037e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:21:59.806656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d8532-4324-4940-8b94-a72a5b03037e admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:21:59.807597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d8532-4324-4940-8b94-a72a5b03037e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:21:59.809477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d8532-4324-4940-8b94-a72a5b03037e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:21:59.835377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 899/1787] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:21:59.847438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d8532-4324-4940-8b94-a72a5b03037e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:59.879089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d8532-4324-4940-8b94-a72a5b03037e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:21:59.886327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a39d76fe634e78b95af62eb0669ee4', 'request_id': 'req-25928ff0-6729-446a-b15c-53f5dbe3addb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:59.902366 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a39d76fe634e78b95af62eb0669ee4', 'request_id': 'req-25928ff0-6729-446a-b15c-53f5dbe3addb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:59.914889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a39d76fe634e78b95af62eb0669ee4', 'request_id': 'req-25928ff0-6729-446a-b15c-53f5dbe3addb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:59.934358 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] The token cache is being invalidate because project 07a39d76fe634e78b95af62eb0669ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:21:59.934992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:59.936043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:21:59.957819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 889/1788] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:21:59 2022] DELETE /identity/v3/projects/07a39d76fe634e78b95af62eb0669ee4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:21:59.961771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:21:59.963476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:21:59.998415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5caf36-3ae4-4f9a-a96a-3baa39ab32b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:21:59.999310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5caf36-3ae4-4f9a-a96a-3baa39ab32b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:21:59.999657 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5caf36-3ae4-4f9a-a96a-3baa39ab32b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:00.000023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5caf36-3ae4-4f9a-a96a-3baa39ab32b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:00.003864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5caf36-3ae4-4f9a-a96a-3baa39ab32b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:00.005651 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5caf36-3ae4-4f9a-a96a-3baa39ab32b0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:00.028671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 900/1789] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:00.034662 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5caf36-3ae4-4f9a-a96a-3baa39ab32b0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:00.036427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-da5caf36-3ae4-4f9a-a96a-3baa39ab32b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:00.058987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5caf36-3ae4-4f9a-a96a-3baa39ab32b0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:00.068484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2bac8-6123-4a5d-891f-7f06a827b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:00.069324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2bac8-6123-4a5d-891f-7f06a827b3dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:00.069759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2bac8-6123-4a5d-891f-7f06a827b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:00.070038 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2bac8-6123-4a5d-891f-7f06a827b3dc admin admin] PATH_INFO: `/v3/projects/6f50c6d08ec04a6dad8f90ad02a73225/users/e50a383452c446d8a4773b1fbf3a2e0a/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:00.097669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2bac8-6123-4a5d-891f-7f06a827b3dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f50c6d08ec04a6dad8f90ad02a73225, user_id=e50a383452c446d8a4773b1fbf3a2e0a, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:00.107376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2bac8-6123-4a5d-891f-7f06a827b3dc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:00.138041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 901/1790] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:00 2022] PUT /identity/v3/projects/6f50c6d08ec04a6dad8f90ad02a73225/users/e50a383452c446d8a4773b1fbf3a2e0a/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:00.149783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a64f3-0620-47d9-83ef-6d63b144496f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:00.150555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a64f3-0620-47d9-83ef-6d63b144496f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:00.151050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a64f3-0620-47d9-83ef-6d63b144496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:00.152295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25928ff0-6729-446a-b15c-53f5dbe3addb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:00.222725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:00.222956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c42a64f3-0620-47d9-83ef-6d63b144496f None None] MFA Rules not processed for user `e50a383452c446d8a4773b1fbf3a2e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:00.227036 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c42a64f3-0620-47d9-83ef-6d63b144496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:00.241566 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:00.242638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:00.243113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:00.243614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] PATH_INFO: `/v3/users/3b672e376a5b461da597081625132d1f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:00.245540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b672e376a5b461da597081625132d1f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:00.247826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:00.346401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b672e376a5b461da597081625132d1f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:00.366389 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 902/1791] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:00.366707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b672e376a5b461da597081625132d1f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:00.367498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a64f3-0620-47d9-83ef-6d63b144496f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:00.384208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a64f3-0620-47d9-83ef-6d63b144496f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:00.389082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b672e376a5b461da597081625132d1f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:00.389424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2608e4-54bc-4c2d-9f09-5ca532d66e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:00.390061 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2608e4-54bc-4c2d-9f09-5ca532d66e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:00.390388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2608e4-54bc-4c2d-9f09-5ca532d66e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:00.390673 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2608e4-54bc-4c2d-9f09-5ca532d66e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:00.391391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2608e4-54bc-4c2d-9f09-5ca532d66e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:00.394202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2608e4-54bc-4c2d-9f09-5ca532d66e66 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:00.436385 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b672e376a5b461da597081625132d1f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:00.439897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b672e376a5b461da597081625132d1f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:00.453860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 903/1793] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:00 2022] POST /identity/v3/projects => generated 397 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:00.456614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 890/1793] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:21:59 2022] DELETE /identity/v3/users/3b672e376a5b461da597081625132d1f => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:00.465070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2608e4-54bc-4c2d-9f09-5ca532d66e66 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:00.482813 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3f2608e4-54bc-4c2d-9f09-5ca532d66e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:00.501377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:00.590392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2608e4-54bc-4c2d-9f09-5ca532d66e66 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:00.711584 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c5c01-d2e6-4413-a91c-b634f9dbc79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:00.713112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5c01-d2e6-4413-a91c-b634f9dbc79b admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:00.713503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5c01-d2e6-4413-a91c-b634f9dbc79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:00.714111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5c01-d2e6-4413-a91c-b634f9dbc79b admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:00.715682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c5c01-d2e6-4413-a91c-b634f9dbc79b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:00.720491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c5c01-d2e6-4413-a91c-b634f9dbc79b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:00.753621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 904/1794] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:00 2022] POST /identity/v3/users => generated 305 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:22:00.757805 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:00.793588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8c73-b138-4c48-8b9a-7ca3ce050fb5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:00.819952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc2317-d400-4c6e-88e7-b5906ef4a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:00.823124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2317-d400-4c6e-88e7-b5906ef4a526 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:00.823456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2317-d400-4c6e-88e7-b5906ef4a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:00.824106 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2317-d400-4c6e-88e7-b5906ef4a526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:00.824862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc2317-d400-4c6e-88e7-b5906ef4a526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:00.828308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc2317-d400-4c6e-88e7-b5906ef4a526 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:00.848044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 891/1795] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:22:00.851897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c5c01-d2e6-4413-a91c-b634f9dbc79b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:00.864383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c5c01-d2e6-4413-a91c-b634f9dbc79b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:00.869999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984ce5e-5603-4df2-b42d-6ad62538de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:00.870895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984ce5e-5603-4df2-b42d-6ad62538de3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:00.871799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984ce5e-5603-4df2-b42d-6ad62538de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:00.872082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984ce5e-5603-4df2-b42d-6ad62538de3b admin admin] PATH_INFO: `/v3/projects/fbd8e43e0eae4647919ab886b5923d05/users/b89a054fce084751be4b213966c05095/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:00.906483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984ce5e-5603-4df2-b42d-6ad62538de3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd8e43e0eae4647919ab886b5923d05, user_id=b89a054fce084751be4b213966c05095, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:00.913787 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984ce5e-5603-4df2-b42d-6ad62538de3b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:00.952519 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 905/1796] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:00 2022] PUT /identity/v3/projects/fbd8e43e0eae4647919ab886b5923d05/users/b89a054fce084751be4b213966c05095/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:00.957269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc2317-d400-4c6e-88e7-b5906ef4a526 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:00.972381 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc2317-d400-4c6e-88e7-b5906ef4a526 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:01.109863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b3b8b-f8b8-434c-bccf-7095d9eb578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:01.110508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3b8b-f8b8-434c-bccf-7095d9eb578b admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:01.110801 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3b8b-f8b8-434c-bccf-7095d9eb578b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:01.111082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3b8b-f8b8-434c-bccf-7095d9eb578b admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:01.111769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b3b8b-f8b8-434c-bccf-7095d9eb578b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:01.115638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b3b8b-f8b8-434c-bccf-7095d9eb578b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:01.146697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 892/1797] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:01.148410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984ce5e-5603-4df2-b42d-6ad62538de3b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:01.160498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984ce5e-5603-4df2-b42d-6ad62538de3b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:01.165191 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d3180-a090-4a6d-9545-c4320f1eea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:01.165869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d3180-a090-4a6d-9545-c4320f1eea76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:01.166152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d3180-a090-4a6d-9545-c4320f1eea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:01.166433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d3180-a090-4a6d-9545-c4320f1eea76 admin admin] PATH_INFO: `/v3/projects/fbd8e43e0eae4647919ab886b5923d05/users/b89a054fce084751be4b213966c05095/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:01.168438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d3180-a090-4a6d-9545-c4320f1eea76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd8e43e0eae4647919ab886b5923d05, user_id=b89a054fce084751be4b213966c05095, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:01.171572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d3180-a090-4a6d-9545-c4320f1eea76 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:01.183203 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 906/1798] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:01 2022] PUT /identity/v3/projects/fbd8e43e0eae4647919ab886b5923d05/users/b89a054fce084751be4b213966c05095/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:01.195146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6621f32-a181-4ef4-bf18-29c46b909d79 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:01.196176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6621f32-a181-4ef4-bf18-29c46b909d79 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:01.196176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6621f32-a181-4ef4-bf18-29c46b909d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:01.234606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d6621f32-a181-4ef4-bf18-29c46b909d79 None None] MFA Rules not processed for user `b89a054fce084751be4b213966c05095`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:01.235847 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d6621f32-a181-4ef4-bf18-29c46b909d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:01.318185 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:01.319015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d3180-a090-4a6d-9545-c4320f1eea76 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:01.321455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-841d3180-a090-4a6d-9545-c4320f1eea76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:01.383644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 893/1799] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:01.404082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6621f32-a181-4ef4-bf18-29c46b909d79 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:01.411456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d6621f32-a181-4ef4-bf18-29c46b909d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:01.499200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6621f32-a181-4ef4-bf18-29c46b909d79 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:01.507748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b31ed-a574-492e-b106-f113d3a53ffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:01.509716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b31ed-a574-492e-b106-f113d3a53ffe service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:01.510096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b31ed-a574-492e-b106-f113d3a53ffe service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:01.510641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b31ed-a574-492e-b106-f113d3a53ffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:01.513503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d3180-a090-4a6d-9545-c4320f1eea76 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:01.528065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b31ed-a574-492e-b106-f113d3a53ffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:01.529810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b31ed-a574-492e-b106-f113d3a53ffe service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:01.543370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:01.543370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:01.543370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:01.543370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] PATH_INFO: `/v3/projects/024e16478487496bacd4059dbebb19a5` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:01.543846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] RBAC: Authorizing `identity:delete_project(project_id=024e16478487496bacd4059dbebb19a5)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:01.543846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:01.544060 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 894/1800] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:01.564201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:01.661566 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b31ed-a574-492e-b106-f113d3a53ffe service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:01.671487 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b31ed-a574-492e-b106-f113d3a53ffe service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:01.674911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024e16478487496bacd4059dbebb19a5', 'request_id': 'req-35f8085f-45ea-4c5b-90c2-fbda0306c75c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:01.708868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024e16478487496bacd4059dbebb19a5', 'request_id': 'req-35f8085f-45ea-4c5b-90c2-fbda0306c75c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:01.721885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024e16478487496bacd4059dbebb19a5', 'request_id': 'req-35f8085f-45ea-4c5b-90c2-fbda0306c75c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:01.741143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] The token cache is being invalidate because project 024e16478487496bacd4059dbebb19a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:01.741143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:01.741877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:01.744795 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 907/1801] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:01 2022] DELETE /identity/v3/projects/024e16478487496bacd4059dbebb19a5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:01.745602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:01.746960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:01.769426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c68dfc-dc80-4ec3-b8a5-aa77e2225850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:01.770203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68dfc-dc80-4ec3-b8a5-aa77e2225850 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:01.771124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68dfc-dc80-4ec3-b8a5-aa77e2225850 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:01.771124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68dfc-dc80-4ec3-b8a5-aa77e2225850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:01.773936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-20c68dfc-dc80-4ec3-b8a5-aa77e2225850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:01.852663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8085f-45ea-4c5b-90c2-fbda0306c75c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:01.858780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c68dfc-dc80-4ec3-b8a5-aa77e2225850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:01.861188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c68dfc-dc80-4ec3-b8a5-aa77e2225850 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:01.862293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:01.863174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:01.863706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:01.864209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] PATH_INFO: `/v3/users/f65fd9949ec4455a890a74763fb433f2` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:01.866420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65fd9949ec4455a890a74763fb433f2)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:01.869645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:01.883410 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 895/1802] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:01 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:22:01.886296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c3ee8-14a5-4753-a707-a0bf91fa71a0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:01.886296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c3ee8-14a5-4753-a707-a0bf91fa71a0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:01.891094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c3ee8-14a5-4753-a707-a0bf91fa71a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:01.931966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-883c3ee8-14a5-4753-a707-a0bf91fa71a0 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:01.933378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-883c3ee8-14a5-4753-a707-a0bf91fa71a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:01.944448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 896/1803] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:01.952858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db8e5-4925-4d27-a88d-732e7b8d144a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:01.953155 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db8e5-4925-4d27-a88d-732e7b8d144a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:01.953417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db8e5-4925-4d27-a88d-732e7b8d144a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:01.956177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65fd9949ec4455a890a74763fb433f2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:01.956814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65fd9949ec4455a890a74763fb433f2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:01.970969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65fd9949ec4455a890a74763fb433f2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:01.981659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65fd9949ec4455a890a74763fb433f2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:01.981860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-090db8e5-4925-4d27-a88d-732e7b8d144a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:01.982634 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-295f7a12-0da1-4d56-b71e-c8c36439c66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65fd9949ec4455a890a74763fb433f2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:01.983161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-090db8e5-4925-4d27-a88d-732e7b8d144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:01.993427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 897/1804] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:01.997556 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090db8e5-4925-4d27-a88d-732e7b8d144a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.009401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090db8e5-4925-4d27-a88d-732e7b8d144a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:02.015705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f7b69-bec0-46f9-a521-789b1088950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:02.016451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f7b69-bec0-46f9-a521-789b1088950e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.016682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f7b69-bec0-46f9-a521-789b1088950e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.017106 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f7b69-bec0-46f9-a521-789b1088950e admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.017762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f7b69-bec0-46f9-a521-789b1088950e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:02.018110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f7b69-bec0-46f9-a521-789b1088950e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:02.019814 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f7b69-bec0-46f9-a521-789b1088950e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:02.032825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 908/1805] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:01 2022] DELETE /identity/v3/users/f65fd9949ec4455a890a74763fb433f2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:02.040426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72498927-a08a-4b9d-a8dd-b60389ce8c08 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.040751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72498927-a08a-4b9d-a8dd-b60389ce8c08 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.040995 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72498927-a08a-4b9d-a8dd-b60389ce8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.050009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 898/1806] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:22:02.051536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f7b69-bec0-46f9-a521-789b1088950e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.074340 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f7b69-bec0-46f9-a521-789b1088950e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:02.088496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-72498927-a08a-4b9d-a8dd-b60389ce8c08 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:02.089676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-72498927-a08a-4b9d-a8dd-b60389ce8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:02.094404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:02.141651 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:02.189694 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b752c79-6c5f-43e1-970e-8bb2c9cd0232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:02.193332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752c79-6c5f-43e1-970e-8bb2c9cd0232 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.193793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752c79-6c5f-43e1-970e-8bb2c9cd0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.194216 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752c79-6c5f-43e1-970e-8bb2c9cd0232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.195013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b752c79-6c5f-43e1-970e-8bb2c9cd0232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:02.197313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b752c79-6c5f-43e1-970e-8bb2c9cd0232 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:02.226221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 909/1807] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:02.227941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac132c-31f9-4400-9392-67f2773815d0 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.228327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac132c-31f9-4400-9392-67f2773815d0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.233315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac132c-31f9-4400-9392-67f2773815d0 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.237582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 910/1808] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:22:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:22:02.241506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac132c-31f9-4400-9392-67f2773815d0 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.245790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-16ac132c-31f9-4400-9392-67f2773815d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:02.267903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 899/1809] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:02 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:02.274168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b752c79-6c5f-43e1-970e-8bb2c9cd0232 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.386052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b752c79-6c5f-43e1-970e-8bb2c9cd0232 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:02.390563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac132c-31f9-4400-9392-67f2773815d0 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:02.394633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5ac33-a1f3-4865-be13-180701e87e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:02.395264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5ac33-a1f3-4865-be13-180701e87e28 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.395573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5ac33-a1f3-4865-be13-180701e87e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.395852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5ac33-a1f3-4865-be13-180701e87e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.397584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ef80e-59ae-4b28-89db-26848fb5d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:02.399217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef80e-59ae-4b28-89db-26848fb5d666 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.399481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef80e-59ae-4b28-89db-26848fb5d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.399985 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef80e-59ae-4b28-89db-26848fb5d666 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.400631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ef80e-59ae-4b28-89db-26848fb5d666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:02.403707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ef80e-59ae-4b28-89db-26848fb5d666 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:02.405522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5ac33-a1f3-4865-be13-180701e87e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:02.407245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5ac33-a1f3-4865-be13-180701e87e28 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:02.419563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 911/1810] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:02.420849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8e98-8c0d-4873-bdca-d309f48115c9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.421139 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8e98-8c0d-4873-bdca-d309f48115c9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.421417 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8e98-8c0d-4873-bdca-d309f48115c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.452292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 900/1811] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:02 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:02.453217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d16b8e98-8c0d-4873-bdca-d309f48115c9 None None] MFA Rules not processed for user `aa89e84c708f44c299c728284e33fabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:02.453928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ef80e-59ae-4b28-89db-26848fb5d666 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.454597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d16b8e98-8c0d-4873-bdca-d309f48115c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:02.456439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2e4ef80e-59ae-4b28-89db-26848fb5d666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:02.472678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ef80e-59ae-4b28-89db-26848fb5d666 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:02.479414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:02.488652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.489545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.490219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] PATH_INFO: `/v3/users/d48b8eb7ac8f43fb92c153ec61b990d7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.491930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48b8eb7ac8f43fb92c153ec61b990d7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:02.496884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:02.580468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 912/1812] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:02.581496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8e98-8c0d-4873-bdca-d309f48115c9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.607752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8e98-8c0d-4873-bdca-d309f48115c9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:02.609497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48b8eb7ac8f43fb92c153ec61b990d7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:02.620409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48b8eb7ac8f43fb92c153ec61b990d7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:02.625094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c99b3-2c4f-4a45-86e7-77a837a2b5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:02.626627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c99b3-2c4f-4a45-86e7-77a837a2b5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.626769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c99b3-2c4f-4a45-86e7-77a837a2b5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.627052 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c99b3-2c4f-4a45-86e7-77a837a2b5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.628213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c99b3-2c4f-4a45-86e7-77a837a2b5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:02.629623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c99b3-2c4f-4a45-86e7-77a837a2b5cb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:02.631115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48b8eb7ac8f43fb92c153ec61b990d7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:02.644060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 913/1813] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:02.645681 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87f592-7b7a-4065-8627-9e2951d0a4e6 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.645981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87f592-7b7a-4065-8627-9e2951d0a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.646331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87f592-7b7a-4065-8627-9e2951d0a4e6 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.647830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 914/1814] 10.222.0.23 () {54 vars in 961 bytes} [Fri Oct 21 21:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:22:02.648557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87f592-7b7a-4065-8627-9e2951d0a4e6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.655883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48b8eb7ac8f43fb92c153ec61b990d7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:02.658015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2adb3713-d703-4ed2-a627-584efbde6645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48b8eb7ac8f43fb92c153ec61b990d7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:02.660355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:02.666253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87f592-7b7a-4065-8627-9e2951d0a4e6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:02.667543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 901/1815] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:02 2022] DELETE /identity/v3/users/d48b8eb7ac8f43fb92c153ec61b990d7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:02.673208 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3064e4-5d81-4962-9564-4db89cf3818d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.673876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3064e4-5d81-4962-9564-4db89cf3818d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.674655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3064e4-5d81-4962-9564-4db89cf3818d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.702269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-dd3064e4-5d81-4962-9564-4db89cf3818d None None] MFA Rules not processed for user `aa89e84c708f44c299c728284e33fabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:02.703769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dd3064e4-5d81-4962-9564-4db89cf3818d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:02.724209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:02.735698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54acf30-e528-49fe-8abb-3b6ecf4fe5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:02.736471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acf30-e528-49fe-8abb-3b6ecf4fe5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.737083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acf30-e528-49fe-8abb-3b6ecf4fe5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.737489 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acf30-e528-49fe-8abb-3b6ecf4fe5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.738211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54acf30-e528-49fe-8abb-3b6ecf4fe5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:02.739999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54acf30-e528-49fe-8abb-3b6ecf4fe5f6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:02.753315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 915/1816] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:02.758116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54acf30-e528-49fe-8abb-3b6ecf4fe5f6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.761602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c54acf30-e528-49fe-8abb-3b6ecf4fe5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:02.778601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54acf30-e528-49fe-8abb-3b6ecf4fe5f6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:02.785908 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6555-8cfb-42d0-91e3-6d58a490d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:02.786966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6555-8cfb-42d0-91e3-6d58a490d9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.787447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6555-8cfb-42d0-91e3-6d58a490d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.787925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6555-8cfb-42d0-91e3-6d58a490d9c1 admin admin] PATH_INFO: `/v3/projects/d3e6703c04424a2286c53fdcb812d484/users/bc27e5c0a0044d1ca8e5f0bb1b61f5ba/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.806260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6555-8cfb-42d0-91e3-6d58a490d9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e6703c04424a2286c53fdcb812d484, user_id=bc27e5c0a0044d1ca8e5f0bb1b61f5ba, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:02.809065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6555-8cfb-42d0-91e3-6d58a490d9c1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:02.828728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 916/1817] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:02 2022] PUT /identity/v3/projects/d3e6703c04424a2286c53fdcb812d484/users/bc27e5c0a0044d1ca8e5f0bb1b61f5ba/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:02.835506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 902/1818] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Oct 21 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:02.839892 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6555-8cfb-42d0-91e3-6d58a490d9c1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.845166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f49c9-f622-459c-8178-998c98aa09bd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.846334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f49c9-f622-459c-8178-998c98aa09bd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.846760 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f49c9-f622-459c-8178-998c98aa09bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.912443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-519f49c9-f622-459c-8178-998c98aa09bd None None] MFA Rules not processed for user `bc27e5c0a0044d1ca8e5f0bb1b61f5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:02.913800 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-519f49c9-f622-459c-8178-998c98aa09bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:02.941874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6555-8cfb-42d0-91e3-6d58a490d9c1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:02.947637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefbe52-932b-4db0-bf57-c177788b389e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa89e84c708f44c299c728284e33fabf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:02.948243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefbe52-932b-4db0-bf57-c177788b389e service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:02.948706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefbe52-932b-4db0-bf57-c177788b389e service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:02.948992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefbe52-932b-4db0-bf57-c177788b389e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:02.951360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-beefbe52-932b-4db0-bf57-c177788b389e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:02.965097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefbe52-932b-4db0-bf57-c177788b389e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:02.966726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefbe52-932b-4db0-bf57-c177788b389e service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:02.976664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 917/1819] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:02.979324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefbe52-932b-4db0-bf57-c177788b389e service placement] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.980639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-beefbe52-932b-4db0-bf57-c177788b389e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:02.989353 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 903/1820] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:02.995501 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f49c9-f622-459c-8178-998c98aa09bd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:02.997925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-519f49c9-f622-459c-8178-998c98aa09bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:03.055174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefbe52-932b-4db0-bf57-c177788b389e service placement] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:03.063556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:03.064368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.064725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.065066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] PATH_INFO: `/v3/projects/ba63d67d3e614402931c8b000b5cc4b6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.066286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba63d67d3e614402931c8b000b5cc4b6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:03.068315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:03.071542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f49c9-f622-459c-8178-998c98aa09bd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:03.076605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:03.077247 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.077526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.077798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] PATH_INFO: `/v3/projects/46f796f815ab436c863d44df2d1ea317` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.079050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f796f815ab436c863d44df2d1ea317)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:03.081245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:03.112902 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:03.121808 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba63d67d3e614402931c8b000b5cc4b6', 'request_id': 'req-23609785-bf5f-47a3-8f5a-15b4c3958a76'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.127035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:03.129758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba63d67d3e614402931c8b000b5cc4b6', 'request_id': 'req-23609785-bf5f-47a3-8f5a-15b4c3958a76'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.136639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f796f815ab436c863d44df2d1ea317', 'request_id': 'req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.139611 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba63d67d3e614402931c8b000b5cc4b6', 'request_id': 'req-23609785-bf5f-47a3-8f5a-15b4c3958a76'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.145097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f796f815ab436c863d44df2d1ea317', 'request_id': 'req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.152714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f796f815ab436c863d44df2d1ea317', 'request_id': 'req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.155521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] The token cache is being invalidate because project ba63d67d3e614402931c8b000b5cc4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:03.155809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.156496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.158208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 918/1821] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:02 2022] DELETE /identity/v3/projects/ba63d67d3e614402931c8b000b5cc4b6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:03.158980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:03.160372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:03.166853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] The token cache is being invalidate because project 46f796f815ab436c863d44df2d1ea317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:03.167368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.168289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.170433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 904/1822] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:02 2022] DELETE /identity/v3/projects/46f796f815ab436c863d44df2d1ea317 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:03.171631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:03.174597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:03.236042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23609785-bf5f-47a3-8f5a-15b4c3958a76 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:03.252070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebcd9d-b60d-4e16-92eb-da8e2582adaf admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:03.257621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:03.258298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.258578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.258852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] PATH_INFO: `/v3/users/69a0ffc1d9d444e28361e5ce85869ab2` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.260046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a0ffc1d9d444e28361e5ce85869ab2)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:03.262157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:03.292430 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b7a6c-8f9a-4042-a3e7-a7f6edc2f8d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:03.293089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b7a6c-8f9a-4042-a3e7-a7f6edc2f8d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.293364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b7a6c-8f9a-4042-a3e7-a7f6edc2f8d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.293641 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b7a6c-8f9a-4042-a3e7-a7f6edc2f8d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.295536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4c9b7a6c-8f9a-4042-a3e7-a7f6edc2f8d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:03.322588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a0ffc1d9d444e28361e5ce85869ab2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.331793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a0ffc1d9d444e28361e5ce85869ab2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.342274 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a0ffc1d9d444e28361e5ce85869ab2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.360064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a0ffc1d9d444e28361e5ce85869ab2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.360990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-38d9cfdb-0df0-4263-b4f7-948fcfb1b22c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a0ffc1d9d444e28361e5ce85869ab2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:03.367935 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 905/1823] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:03 2022] DELETE /identity/v3/users/69a0ffc1d9d444e28361e5ce85869ab2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:03.369543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c892e-9bf2-467d-91ee-1d3829613512 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.370822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c892e-9bf2-467d-91ee-1d3829613512 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.370822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c892e-9bf2-467d-91ee-1d3829613512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.372643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b7a6c-8f9a-4042-a3e7-a7f6edc2f8d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:03.374315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b7a6c-8f9a-4042-a3e7-a7f6edc2f8d6 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:03.384609 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 919/1824] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:03.394368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-940c892e-9bf2-467d-91ee-1d3829613512 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:03.395633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-940c892e-9bf2-467d-91ee-1d3829613512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:03.430036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:03.504531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 906/1825] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:03.506009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5e29b-74d4-4c4c-a106-6fc4bbc6f12f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.506495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5e29b-74d4-4c4c-a106-6fc4bbc6f12f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.506877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5e29b-74d4-4c4c-a106-6fc4bbc6f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.534665 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e2d5e29b-74d4-4c4c-a106-6fc4bbc6f12f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:03.536162 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e2d5e29b-74d4-4c4c-a106-6fc4bbc6f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:03.545650 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 920/1826] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:03.550385 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c892e-9bf2-467d-91ee-1d3829613512 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:03.562617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c892e-9bf2-467d-91ee-1d3829613512 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:03.572770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2dee0-5cf4-48a6-9f60-f78342e9df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:03.573862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2dee0-5cf4-48a6-9f60-f78342e9df43 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.573862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2dee0-5cf4-48a6-9f60-f78342e9df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.573862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2dee0-5cf4-48a6-9f60-f78342e9df43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.574492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2dee0-5cf4-48a6-9f60-f78342e9df43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:03.574793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2dee0-5cf4-48a6-9f60-f78342e9df43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:03.576689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2dee0-5cf4-48a6-9f60-f78342e9df43 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:03.612225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 907/1827] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:22:03.617160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5e29b-74d4-4c4c-a106-6fc4bbc6f12f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:03.641692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5e29b-74d4-4c4c-a106-6fc4bbc6f12f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:03.657357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ad63d-b6f5-4222-9d0e-5ab04272aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:03.659407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ad63d-b6f5-4222-9d0e-5ab04272aa1f admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.660603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ad63d-b6f5-4222-9d0e-5ab04272aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.661237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ad63d-b6f5-4222-9d0e-5ab04272aa1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.662167 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ad63d-b6f5-4222-9d0e-5ab04272aa1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:03.665079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ad63d-b6f5-4222-9d0e-5ab04272aa1f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:03.722101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 921/1828] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:03 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:03.725819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2dee0-5cf4-48a6-9f60-f78342e9df43 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:03.746268 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2dee0-5cf4-48a6-9f60-f78342e9df43 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:03.840264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368c74b-9c90-437e-a609-216bbe6015fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:03.841446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368c74b-9c90-437e-a609-216bbe6015fb admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.841883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368c74b-9c90-437e-a609-216bbe6015fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.842379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368c74b-9c90-437e-a609-216bbe6015fb admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.843575 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368c74b-9c90-437e-a609-216bbe6015fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:03.846733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368c74b-9c90-437e-a609-216bbe6015fb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:03.879174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 908/1829] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:03 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:03.883110 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ad63d-b6f5-4222-9d0e-5ab04272aa1f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:03.900039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ad63d-b6f5-4222-9d0e-5ab04272aa1f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:03.914284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368c74b-9c90-437e-a609-216bbe6015fb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:03.915035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ce14-4929-4614-a5f7-e325cd92ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:03.915948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ce14-4929-4614-a5f7-e325cd92ab9d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.916395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ce14-4929-4614-a5f7-e325cd92ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.916680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ce14-4929-4614-a5f7-e325cd92ab9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.918601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94ce14-4929-4614-a5f7-e325cd92ab9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:03.920922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94ce14-4929-4614-a5f7-e325cd92ab9d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:03.925312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1368c74b-9c90-437e-a609-216bbe6015fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:03.950809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368c74b-9c90-437e-a609-216bbe6015fb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:03.962215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:03.964222 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:03.964579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:03.964756 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] PATH_INFO: `/v3/projects/36fe5c1a196e42a68d7223ec72741f01` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:03.969114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36fe5c1a196e42a68d7223ec72741f01)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:03.973865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:03.977189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 922/1830] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:22:03.978380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ce14-4929-4614-a5f7-e325cd92ab9d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:03.999715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ce14-4929-4614-a5f7-e325cd92ab9d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.035453 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b3e12-2a2e-48f5-b18f-5155cedb3db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.036300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b3e12-2a2e-48f5-b18f-5155cedb3db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.038238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b3e12-2a2e-48f5-b18f-5155cedb3db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.039477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b3e12-2a2e-48f5-b18f-5155cedb3db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.040796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b3e12-2a2e-48f5-b18f-5155cedb3db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.042331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b3e12-2a2e-48f5-b18f-5155cedb3db9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:04.086929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 923/1831] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:04.087812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b3e12-2a2e-48f5-b18f-5155cedb3db9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:04.091486 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36fe5c1a196e42a68d7223ec72741f01', 'request_id': 'req-d2936791-aa97-4354-8750-7aac008c9351'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:04.100429 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:04.103073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36fe5c1a196e42a68d7223ec72741f01', 'request_id': 'req-d2936791-aa97-4354-8750-7aac008c9351'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:04.107555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b3e12-2a2e-48f5-b18f-5155cedb3db9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.113273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36fe5c1a196e42a68d7223ec72741f01', 'request_id': 'req-d2936791-aa97-4354-8750-7aac008c9351'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:04.132537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] The token cache is being invalidate because project 36fe5c1a196e42a68d7223ec72741f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:04.132840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:04.133547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d2936791-aa97-4354-8750-7aac008c9351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:04.135092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 909/1832] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:03 2022] DELETE /identity/v3/projects/36fe5c1a196e42a68d7223ec72741f01 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:04.140816 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298a877-b0fd-4113-b772-fb5efd480f92 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.141703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298a877-b0fd-4113-b772-fb5efd480f92 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.142045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298a877-b0fd-4113-b772-fb5efd480f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.162505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0298a877-b0fd-4113-b772-fb5efd480f92 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:04.163887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0298a877-b0fd-4113-b772-fb5efd480f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:04.173929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170ba6c-41c6-410a-aba9-89c46bf18a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.174595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170ba6c-41c6-410a-aba9-89c46bf18a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.174882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170ba6c-41c6-410a-aba9-89c46bf18a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.175161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170ba6c-41c6-410a-aba9-89c46bf18a6a admin admin] PATH_INFO: `/v3/projects/f8d0aa624c7e49f1a9d9e5473bac4547/users/54d2608c7c8e4d7581fd9a944d8f18e0/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.190678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170ba6c-41c6-410a-aba9-89c46bf18a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d0aa624c7e49f1a9d9e5473bac4547, user_id=54d2608c7c8e4d7581fd9a944d8f18e0, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.193422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170ba6c-41c6-410a-aba9-89c46bf18a6a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:04.195322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:04.207967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 924/1833] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:04 2022] PUT /identity/v3/projects/f8d0aa624c7e49f1a9d9e5473bac4547/users/54d2608c7c8e4d7581fd9a944d8f18e0/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:04.212969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1061b6-56dc-4b6c-a61a-969af4ecf1b5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.213387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1061b6-56dc-4b6c-a61a-969af4ecf1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.213780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1061b6-56dc-4b6c-a61a-969af4ecf1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.231202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 910/1834] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:04.232345 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-af1061b6-56dc-4b6c-a61a-969af4ecf1b5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:04.233560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-af1061b6-56dc-4b6c-a61a-969af4ecf1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:04.240414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f032-3b8e-42f5-af37-002f2bd4dff6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.240699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f032-3b8e-42f5-af37-002f2bd4dff6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.240979 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f032-3b8e-42f5-af37-002f2bd4dff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.263221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3575f032-3b8e-42f5-af37-002f2bd4dff6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:04.264616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3575f032-3b8e-42f5-af37-002f2bd4dff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:04.309775 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 925/1835] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:04.321053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1061b6-56dc-4b6c-a61a-969af4ecf1b5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:04.322483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-af1061b6-56dc-4b6c-a61a-969af4ecf1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:04.332647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 911/1836] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:04.336842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575f032-3b8e-42f5-af37-002f2bd4dff6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:04.346141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575f032-3b8e-42f5-af37-002f2bd4dff6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.351939 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d531d80-4ad1-4b0a-b86d-76c49eb4414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.352540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d531d80-4ad1-4b0a-b86d-76c49eb4414d admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.352822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d531d80-4ad1-4b0a-b86d-76c49eb4414d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.353095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d531d80-4ad1-4b0a-b86d-76c49eb4414d admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.353951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d531d80-4ad1-4b0a-b86d-76c49eb4414d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:04.354257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d531d80-4ad1-4b0a-b86d-76c49eb4414d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.356335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d531d80-4ad1-4b0a-b86d-76c49eb4414d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:04.368412 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 912/1837] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:22:04.372651 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d531d80-4ad1-4b0a-b86d-76c49eb4414d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:04.383337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d531d80-4ad1-4b0a-b86d-76c49eb4414d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.383492 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1061b6-56dc-4b6c-a61a-969af4ecf1b5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.387043 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f563a-5104-468f-961b-e9343836b13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.387689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f563a-5104-468f-961b-e9343836b13f service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.387971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f563a-5104-468f-961b-e9343836b13f service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.388063 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cef4a-9b43-49cd-9c08-11658cbd831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.388309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f563a-5104-468f-961b-e9343836b13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.388580 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cef4a-9b43-49cd-9c08-11658cbd831b admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.388856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cef4a-9b43-49cd-9c08-11658cbd831b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.389125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cef4a-9b43-49cd-9c08-11658cbd831b admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.389743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cef4a-9b43-49cd-9c08-11658cbd831b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.392242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cef4a-9b43-49cd-9c08-11658cbd831b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:04.397933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f563a-5104-468f-961b-e9343836b13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.399383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f563a-5104-468f-961b-e9343836b13f service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:04.409355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 926/1838] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:22:04.422654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 913/1839] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:04 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:22:04.423982 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f563a-5104-468f-961b-e9343836b13f service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:04.433572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f563a-5104-468f-961b-e9343836b13f service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.461077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:04.495182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31a721-7e48-41be-82d6-69560cc9e5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.495826 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a721-7e48-41be-82d6-69560cc9e5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.496169 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a721-7e48-41be-82d6-69560cc9e5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.496381 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a721-7e48-41be-82d6-69560cc9e5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.497126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31a721-7e48-41be-82d6-69560cc9e5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.499073 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31a721-7e48-41be-82d6-69560cc9e5f4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:04.524964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 927/1840] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:04 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:04.526133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cef4a-9b43-49cd-9c08-11658cbd831b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:04.537027 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cef4a-9b43-49cd-9c08-11658cbd831b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.542320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83565e6b-f6b0-4efa-8648-feb212b0929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.542693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565e6b-f6b0-4efa-8648-feb212b0929d admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.542969 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565e6b-f6b0-4efa-8648-feb212b0929d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.543238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565e6b-f6b0-4efa-8648-feb212b0929d admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.543910 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83565e6b-f6b0-4efa-8648-feb212b0929d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.545541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83565e6b-f6b0-4efa-8648-feb212b0929d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:04.557232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 914/1841] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:04.561087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31a721-7e48-41be-82d6-69560cc9e5f4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:04.571864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31a721-7e48-41be-82d6-69560cc9e5f4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.577668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55903a9b-77a7-4471-839d-990d96830fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.578464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55903a9b-77a7-4471-839d-990d96830fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.578750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55903a9b-77a7-4471-839d-990d96830fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.579014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55903a9b-77a7-4471-839d-990d96830fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.579715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55903a9b-77a7-4471-839d-990d96830fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.581297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55903a9b-77a7-4471-839d-990d96830fc9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:04.593590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 928/1842] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:04.597300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83565e6b-f6b0-4efa-8648-feb212b0929d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:04.609017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83565e6b-f6b0-4efa-8648-feb212b0929d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.615225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c459a1-cd29-4cca-b7be-46adfbb883ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.616089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c459a1-cd29-4cca-b7be-46adfbb883ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.616375 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c459a1-cd29-4cca-b7be-46adfbb883ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.616689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c459a1-cd29-4cca-b7be-46adfbb883ab admin admin] PATH_INFO: `/v3/projects/2399326a71db4a8da4df83e4172be0b4/users/ca2b4178a1ef418fbbbf5de6107cfcec/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.633009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c459a1-cd29-4cca-b7be-46adfbb883ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2399326a71db4a8da4df83e4172be0b4, user_id=ca2b4178a1ef418fbbbf5de6107cfcec, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.635706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c459a1-cd29-4cca-b7be-46adfbb883ab admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:04.649343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 915/1843] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:04 2022] PUT /identity/v3/projects/2399326a71db4a8da4df83e4172be0b4/users/ca2b4178a1ef418fbbbf5de6107cfcec/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:04.662947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2078d11-5fe3-467f-83ef-d4f293c10a25 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.663438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2078d11-5fe3-467f-83ef-d4f293c10a25 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.663675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2078d11-5fe3-467f-83ef-d4f293c10a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.693870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c2078d11-5fe3-467f-83ef-d4f293c10a25 None None] MFA Rules not processed for user `ca2b4178a1ef418fbbbf5de6107cfcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:04.695090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c2078d11-5fe3-467f-83ef-d4f293c10a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:04.768576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 929/1844] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:04.781500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c459a1-cd29-4cca-b7be-46adfbb883ab admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:04.783406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-86c459a1-cd29-4cca-b7be-46adfbb883ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:04.847529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c459a1-cd29-4cca-b7be-46adfbb883ab admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.851122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8634-c8bd-4c86-943e-7312acea2d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.851774 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8634-c8bd-4c86-943e-7312acea2d3e service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.852086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8634-c8bd-4c86-943e-7312acea2d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.852331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8634-c8bd-4c86-943e-7312acea2d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.862465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8634-c8bd-4c86-943e-7312acea2d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.863928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8634-c8bd-4c86-943e-7312acea2d3e service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:04.872979 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 916/1845] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:04.895331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2078d11-5fe3-467f-83ef-d4f293c10a25 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:04.960737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2078d11-5fe3-467f-83ef-d4f293c10a25 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:04.965221 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:04.965861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:04.966142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:04.966416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] PATH_INFO: `/v3/users/ca2b4178a1ef418fbbbf5de6107cfcec` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:04.967567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2b4178a1ef418fbbbf5de6107cfcec)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:04.969520 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:05.011781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:05.022545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2b4178a1ef418fbbbf5de6107cfcec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:05.023515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2b4178a1ef418fbbbf5de6107cfcec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:05.033778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2b4178a1ef418fbbbf5de6107cfcec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:05.042307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2b4178a1ef418fbbbf5de6107cfcec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:05.043101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2b4178a1ef418fbbbf5de6107cfcec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:05.076660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 930/1846] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:04 2022] DELETE /identity/v3/users/ca2b4178a1ef418fbbbf5de6107cfcec => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:05.079356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ea29c-3971-4214-a1d4-f3c3d84cabc1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:05.080417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ea29c-3971-4214-a1d4-f3c3d84cabc1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:05.080417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ea29c-3971-4214-a1d4-f3c3d84cabc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:05.112977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:05.138645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0e5ea29c-3971-4214-a1d4-f3c3d84cabc1 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:05.146499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0e5ea29c-3971-4214-a1d4-f3c3d84cabc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:05.310378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 917/1847] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:05.363841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:05.365989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:05.495971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ec4cb-512d-4bc0-a922-1fe8960cd16d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:05.500943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c6a5c-5c65-4fac-b944-76e7d9395d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:05.501784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c6a5c-5c65-4fac-b944-76e7d9395d92 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:05.502164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c6a5c-5c65-4fac-b944-76e7d9395d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:05.502538 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c6a5c-5c65-4fac-b944-76e7d9395d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:05.529832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c6a5c-5c65-4fac-b944-76e7d9395d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:05.531408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c6a5c-5c65-4fac-b944-76e7d9395d92 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:05.542468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 931/1848] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:05.965895 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ea29c-3971-4214-a1d4-f3c3d84cabc1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:05.967787 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0e5ea29c-3971-4214-a1d4-f3c3d84cabc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:06.024583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ea29c-3971-4214-a1d4-f3c3d84cabc1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:06.034571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:06.037126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:06.037739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:06.038190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] PATH_INFO: `/v3/projects/2399326a71db4a8da4df83e4172be0b4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:06.039846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2399326a71db4a8da4df83e4172be0b4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:06.043576 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:06.140216 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2399326a71db4a8da4df83e4172be0b4', 'request_id': 'req-400c8de8-1a3a-438f-a09d-27eb965b6872'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:06.161173 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2399326a71db4a8da4df83e4172be0b4', 'request_id': 'req-400c8de8-1a3a-438f-a09d-27eb965b6872'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:06.178044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2399326a71db4a8da4df83e4172be0b4', 'request_id': 'req-400c8de8-1a3a-438f-a09d-27eb965b6872'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:06.191103 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] The token cache is being invalidate because project 2399326a71db4a8da4df83e4172be0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:06.191519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:06.192249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-400c8de8-1a3a-438f-a09d-27eb965b6872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:06.194972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 918/1849] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:05 2022] DELETE /identity/v3/projects/2399326a71db4a8da4df83e4172be0b4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:06.199576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b853ec-668b-4f66-ac04-d61f0feeb37c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:06.200042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b853ec-668b-4f66-ac04-d61f0feeb37c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:06.200130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b853ec-668b-4f66-ac04-d61f0feeb37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:06.225538 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c3b853ec-668b-4f66-ac04-d61f0feeb37c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:06.226943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c3b853ec-668b-4f66-ac04-d61f0feeb37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:06.302541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 932/1850] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:06.305541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8564da-ae0f-4b41-b6dc-8fd09792cd9b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:06.306080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8564da-ae0f-4b41-b6dc-8fd09792cd9b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:06.306481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8564da-ae0f-4b41-b6dc-8fd09792cd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:06.340982 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8b8564da-ae0f-4b41-b6dc-8fd09792cd9b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:06.342295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8b8564da-ae0f-4b41-b6dc-8fd09792cd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:06.356577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 919/1851] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:06.365667 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b853ec-668b-4f66-ac04-d61f0feeb37c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:06.387198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b853ec-668b-4f66-ac04-d61f0feeb37c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:06.393170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52259fa1-ce2d-407f-be83-878327044499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:06.393990 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52259fa1-ce2d-407f-be83-878327044499 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:06.394484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52259fa1-ce2d-407f-be83-878327044499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:06.394824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52259fa1-ce2d-407f-be83-878327044499 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:06.395856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52259fa1-ce2d-407f-be83-878327044499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:06.396250 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52259fa1-ce2d-407f-be83-878327044499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:06.398102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52259fa1-ce2d-407f-be83-878327044499 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:06.413730 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 933/1852] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:22:06.423903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8564da-ae0f-4b41-b6dc-8fd09792cd9b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:06.437486 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8564da-ae0f-4b41-b6dc-8fd09792cd9b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:06.447531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a63616-24fc-4806-b1d3-3bcb89dcf119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:06.448164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a63616-24fc-4806-b1d3-3bcb89dcf119 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:06.448453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a63616-24fc-4806-b1d3-3bcb89dcf119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:06.449354 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a63616-24fc-4806-b1d3-3bcb89dcf119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:06.449637 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a63616-24fc-4806-b1d3-3bcb89dcf119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:06.451859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a63616-24fc-4806-b1d3-3bcb89dcf119 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:06.498634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 920/1853] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:06 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:06.499454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52259fa1-ce2d-407f-be83-878327044499 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:06.514267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52259fa1-ce2d-407f-be83-878327044499 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:06.595436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:06.646052 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea086907-dd51-4248-9219-62a9e117ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:06.647854 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea086907-dd51-4248-9219-62a9e117ca18 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:06.649936 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea086907-dd51-4248-9219-62a9e117ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:06.650313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea086907-dd51-4248-9219-62a9e117ca18 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:06.651046 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea086907-dd51-4248-9219-62a9e117ca18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:06.659288 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea086907-dd51-4248-9219-62a9e117ca18 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:06.711738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 934/1854] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:06 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:06.713765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a63616-24fc-4806-b1d3-3bcb89dcf119 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:06.736371 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a63616-24fc-4806-b1d3-3bcb89dcf119 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:06.745666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88b9aa-1536-461f-9c3d-2c1e1357007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:06.746419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88b9aa-1536-461f-9c3d-2c1e1357007e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:06.747568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88b9aa-1536-461f-9c3d-2c1e1357007e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:06.749056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88b9aa-1536-461f-9c3d-2c1e1357007e admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:06.749709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88b9aa-1536-461f-9c3d-2c1e1357007e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:06.755898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88b9aa-1536-461f-9c3d-2c1e1357007e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:06.780897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 921/1855] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:06.784668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea086907-dd51-4248-9219-62a9e117ca18 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:06.805565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea086907-dd51-4248-9219-62a9e117ca18 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:06.821699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb3753-7c62-469d-8036-8f8b3ec4fa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:06.822420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb3753-7c62-469d-8036-8f8b3ec4fa3a admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:06.823766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb3753-7c62-469d-8036-8f8b3ec4fa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:06.824065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb3753-7c62-469d-8036-8f8b3ec4fa3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:06.824737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb3753-7c62-469d-8036-8f8b3ec4fa3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:06.826629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb3753-7c62-469d-8036-8f8b3ec4fa3a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:06.862573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 935/1856] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:06.865997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88b9aa-1536-461f-9c3d-2c1e1357007e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:06.882257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88b9aa-1536-461f-9c3d-2c1e1357007e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:06.900033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4fa7c-3482-4914-b50e-41561eda65b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:06.900994 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4fa7c-3482-4914-b50e-41561eda65b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:06.901390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4fa7c-3482-4914-b50e-41561eda65b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:06.901918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4fa7c-3482-4914-b50e-41561eda65b3 admin admin] PATH_INFO: `/v3/projects/2cb07933242a401787271516f502f229/users/310f60db1a614850884bf455040bc809/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:06.935690 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4fa7c-3482-4914-b50e-41561eda65b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb07933242a401787271516f502f229, user_id=310f60db1a614850884bf455040bc809, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:06.942165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4fa7c-3482-4914-b50e-41561eda65b3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:06.970172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 922/1857] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:06 2022] PUT /identity/v3/projects/2cb07933242a401787271516f502f229/users/310f60db1a614850884bf455040bc809/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:06.981395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d664-7e0e-4fc1-85b9-73e1514fec20 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:06.981875 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d664-7e0e-4fc1-85b9-73e1514fec20 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:06.983017 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d664-7e0e-4fc1-85b9-73e1514fec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:06.994291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4fa7c-3482-4914-b50e-41561eda65b3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:06.996276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a1a4fa7c-3482-4914-b50e-41561eda65b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:07.045513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3ba9d664-7e0e-4fc1-85b9-73e1514fec20 None None] MFA Rules not processed for user `310f60db1a614850884bf455040bc809`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:07.047857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3ba9d664-7e0e-4fc1-85b9-73e1514fec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:07.107219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:07.202892 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4fa7c-3482-4914-b50e-41561eda65b3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:07.212036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:07.213444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:07.213998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:07.214543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] PATH_INFO: `/v3/users/e50a383452c446d8a4773b1fbf3a2e0a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:07.216466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50a383452c446d8a4773b1fbf3a2e0a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:07.219683 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:07.235791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 936/1858] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:07.246743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9d664-7e0e-4fc1-85b9-73e1514fec20 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:07.249354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3ba9d664-7e0e-4fc1-85b9-73e1514fec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:07.375737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50a383452c446d8a4773b1fbf3a2e0a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:07.392951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50a383452c446d8a4773b1fbf3a2e0a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:07.412213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50a383452c446d8a4773b1fbf3a2e0a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:07.428495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9d664-7e0e-4fc1-85b9-73e1514fec20 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:07.438054 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69028204-a2e3-4c3d-9f82-986740415929 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec1b2a49264e4e9218b65f9ff114b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:07.438798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69028204-a2e3-4c3d-9f82-986740415929 service glance] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:07.438979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69028204-a2e3-4c3d-9f82-986740415929 service glance] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:07.439528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69028204-a2e3-4c3d-9f82-986740415929 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:07.452121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50a383452c446d8a4773b1fbf3a2e0a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:07.453788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39b49ac2-6d8c-4f40-86e2-5d8f2c17f125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50a383452c446d8a4773b1fbf3a2e0a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:07.460037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69028204-a2e3-4c3d-9f82-986740415929 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:07.461971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69028204-a2e3-4c3d-9f82-986740415929 service glance] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:07.470037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 923/1859] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:06 2022] DELETE /identity/v3/users/e50a383452c446d8a4773b1fbf3a2e0a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:07.480874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9996-bbf2-4789-8f01-b634f67525d5 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:07.481254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9996-bbf2-4789-8f01-b634f67525d5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:07.481474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9996-bbf2-4789-8f01-b634f67525d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:07.490461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 937/1860] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:07.541228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-fb1f9996-bbf2-4789-8f01-b634f67525d5 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:07.543394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fb1f9996-bbf2-4789-8f01-b634f67525d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:07.661627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 924/1861] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:07.674678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69028204-a2e3-4c3d-9f82-986740415929 service glance] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:07.676330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-69028204-a2e3-4c3d-9f82-986740415929 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:07.818453 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69028204-a2e3-4c3d-9f82-986740415929 service glance] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:07.840394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:07.912236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a716f81-ad06-4eb6-a25e-58b2cb057ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:07.912861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a716f81-ad06-4eb6-a25e-58b2cb057ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:07.913138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a716f81-ad06-4eb6-a25e-58b2cb057ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:07.913410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a716f81-ad06-4eb6-a25e-58b2cb057ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:07.935077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a716f81-ad06-4eb6-a25e-58b2cb057ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:07.936799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a716f81-ad06-4eb6-a25e-58b2cb057ca7 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:07.964509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 938/1862] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:08.514746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f9996-bbf2-4789-8f01-b634f67525d5 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:08.517319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fb1f9996-bbf2-4789-8f01-b634f67525d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:08.539732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f9996-bbf2-4789-8f01-b634f67525d5 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:08.551261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:08.552680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:08.553496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:08.553980 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] PATH_INFO: `/v3/projects/6f50c6d08ec04a6dad8f90ad02a73225` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:08.555767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f50c6d08ec04a6dad8f90ad02a73225)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:08.558673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:08.659407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:08.682419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f50c6d08ec04a6dad8f90ad02a73225', 'request_id': 'req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:08.705453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f50c6d08ec04a6dad8f90ad02a73225', 'request_id': 'req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:08.719091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f50c6d08ec04a6dad8f90ad02a73225', 'request_id': 'req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:08.734952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] The token cache is being invalidate because project 6f50c6d08ec04a6dad8f90ad02a73225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:08.735506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:08.743355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:08.747010 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 925/1863] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:08 2022] DELETE /identity/v3/projects/6f50c6d08ec04a6dad8f90ad02a73225 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:08.752493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a716f81-ad06-4eb6-a25e-58b2cb057ca7 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:08.773789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a716f81-ad06-4eb6-a25e-58b2cb057ca7 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:08.904661 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:08.905515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:08.905899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:08.906508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] PATH_INFO: `/v3/users/b89a054fce084751be4b213966c05095` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:08.908930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89a054fce084751be4b213966c05095)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:08.911712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:09.008979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89a054fce084751be4b213966c05095'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:09.009760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89a054fce084751be4b213966c05095'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:09.038929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89a054fce084751be4b213966c05095'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:09.066385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89a054fce084751be4b213966c05095'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:09.067976 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89a054fce084751be4b213966c05095'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:09.118577 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 939/1864] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:08 2022] DELETE /identity/v3/users/b89a054fce084751be4b213966c05095 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:09.155003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:09.157537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:09.264089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbbcfa-4c65-462d-9ce5-7f45d623f6d1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:09.416320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df215a9-cede-459f-b277-94e6f4feada5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:09.417274 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df215a9-cede-459f-b277-94e6f4feada5 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:09.417618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df215a9-cede-459f-b277-94e6f4feada5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:09.418172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df215a9-cede-459f-b277-94e6f4feada5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:09.421618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2df215a9-cede-459f-b277-94e6f4feada5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:09.573941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df215a9-cede-459f-b277-94e6f4feada5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:09.576522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df215a9-cede-459f-b277-94e6f4feada5 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:09.600699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 926/1865] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:09.634699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:09.636728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:09.699890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:09.746845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047fe7c-ebd0-456e-b02a-97dcaf14bf01 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:09.753620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:09.755400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:09.755846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:09.756267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] PATH_INFO: `/v3/projects/fbd8e43e0eae4647919ab886b5923d05` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:09.768332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd8e43e0eae4647919ab886b5923d05)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:09.778918 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:09.858934 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd8e43e0eae4647919ab886b5923d05', 'request_id': 'req-3444f8a6-0fec-442c-9a72-c6db5b3997d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:09.865829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd8e43e0eae4647919ab886b5923d05', 'request_id': 'req-3444f8a6-0fec-442c-9a72-c6db5b3997d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:09.873366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd8e43e0eae4647919ab886b5923d05', 'request_id': 'req-3444f8a6-0fec-442c-9a72-c6db5b3997d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:09.894050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] The token cache is being invalidate because project fbd8e43e0eae4647919ab886b5923d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:09.894351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:09.895293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3444f8a6-0fec-442c-9a72-c6db5b3997d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:09.901047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 940/1866] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:09 2022] DELETE /identity/v3/projects/fbd8e43e0eae4647919ab886b5923d05 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:09.907212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02f87-f72e-42af-a907-5659fabfe04e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:09.908537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02f87-f72e-42af-a907-5659fabfe04e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:09.908823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02f87-f72e-42af-a907-5659fabfe04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:09.950050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d9e02f87-f72e-42af-a907-5659fabfe04e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:09.955242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d9e02f87-f72e-42af-a907-5659fabfe04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:09.997285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:10.068404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 927/1867] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:10.076678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f930782-d866-4d3b-ad9e-813e0b1b863a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:10.077072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f930782-d866-4d3b-ad9e-813e0b1b863a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:10.077451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f930782-d866-4d3b-ad9e-813e0b1b863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:10.112802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9f930782-d866-4d3b-ad9e-813e0b1b863a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:10.115020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9f930782-d866-4d3b-ad9e-813e0b1b863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:10.131678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 941/1868] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:10.132992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e02f87-f72e-42af-a907-5659fabfe04e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:10.144684 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e02f87-f72e-42af-a907-5659fabfe04e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:10.150983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40965055-baa6-485b-b41e-51ae75131cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:10.151738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40965055-baa6-485b-b41e-51ae75131cab admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:10.152092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40965055-baa6-485b-b41e-51ae75131cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:10.152877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40965055-baa6-485b-b41e-51ae75131cab admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:10.153606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40965055-baa6-485b-b41e-51ae75131cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:10.153984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40965055-baa6-485b-b41e-51ae75131cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:10.155991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40965055-baa6-485b-b41e-51ae75131cab admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:10.172214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 928/1869] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:22:10.176578 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f930782-d866-4d3b-ad9e-813e0b1b863a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:10.187127 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f930782-d866-4d3b-ad9e-813e0b1b863a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:10.216245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ca62b-8459-451f-97ed-99af34bb8375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:10.218408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ca62b-8459-451f-97ed-99af34bb8375 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:10.218825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ca62b-8459-451f-97ed-99af34bb8375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:10.222049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ca62b-8459-451f-97ed-99af34bb8375 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:10.222849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ca62b-8459-451f-97ed-99af34bb8375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:10.227237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ca62b-8459-451f-97ed-99af34bb8375 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:10.293319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 942/1870] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:10 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:10.293479 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40965055-baa6-485b-b41e-51ae75131cab admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:10.305452 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40965055-baa6-485b-b41e-51ae75131cab admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:10.441878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d57f4f-3697-4db2-859c-c80e8458ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:10.442514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d57f4f-3697-4db2-859c-c80e8458ab76 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:10.442798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d57f4f-3697-4db2-859c-c80e8458ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:10.443070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d57f4f-3697-4db2-859c-c80e8458ab76 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:10.443768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d57f4f-3697-4db2-859c-c80e8458ab76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:10.445719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d57f4f-3697-4db2-859c-c80e8458ab76 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:10.502129 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 929/1871] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:10 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:10.506173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ca62b-8459-451f-97ed-99af34bb8375 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:10.520504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ca62b-8459-451f-97ed-99af34bb8375 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:10.533853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbf23d-0090-4369-9e31-8a7e27ebbf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:10.534546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbf23d-0090-4369-9e31-8a7e27ebbf25 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:10.534822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbf23d-0090-4369-9e31-8a7e27ebbf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:10.535092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbf23d-0090-4369-9e31-8a7e27ebbf25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:10.535829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbf23d-0090-4369-9e31-8a7e27ebbf25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:10.537352 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbf23d-0090-4369-9e31-8a7e27ebbf25 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:10.556841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 943/1872] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:10.561374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d57f4f-3697-4db2-859c-c80e8458ab76 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:10.588306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d57f4f-3697-4db2-859c-c80e8458ab76 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:10.593785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b310af0-a286-48de-8804-4a5e79e1eec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:10.594662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310af0-a286-48de-8804-4a5e79e1eec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:10.595093 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310af0-a286-48de-8804-4a5e79e1eec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:10.595726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310af0-a286-48de-8804-4a5e79e1eec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:10.596512 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b310af0-a286-48de-8804-4a5e79e1eec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:10.600243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b310af0-a286-48de-8804-4a5e79e1eec1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:10.628245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbf23d-0090-4369-9e31-8a7e27ebbf25 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:10.636309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 930/1873] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:10.642104 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbf23d-0090-4369-9e31-8a7e27ebbf25 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:10.659666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4dc07-33e7-4a0d-abd4-456ada60db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:10.660403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4dc07-33e7-4a0d-abd4-456ada60db3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:10.661314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4dc07-33e7-4a0d-abd4-456ada60db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:10.661464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4dc07-33e7-4a0d-abd4-456ada60db3a admin admin] PATH_INFO: `/v3/projects/c6d1d5b4afb14300bd85070cc9220570/users/34cf87904b704b0ab68e545acc864c8f/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:10.708585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4dc07-33e7-4a0d-abd4-456ada60db3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d1d5b4afb14300bd85070cc9220570, user_id=34cf87904b704b0ab68e545acc864c8f, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:10.711331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4dc07-33e7-4a0d-abd4-456ada60db3a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:10.752286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 944/1874] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:10 2022] PUT /identity/v3/projects/c6d1d5b4afb14300bd85070cc9220570/users/34cf87904b704b0ab68e545acc864c8f/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:10.764317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794c92-05e4-44d0-ac6f-d97757027dab None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:10.764821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794c92-05e4-44d0-ac6f-d97757027dab None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:10.765273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794c92-05e4-44d0-ac6f-d97757027dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:10.816745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-51794c92-05e4-44d0-ac6f-d97757027dab None None] MFA Rules not processed for user `34cf87904b704b0ab68e545acc864c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:10.819234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-51794c92-05e4-44d0-ac6f-d97757027dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:10.943436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949adf7-598d-47f1-acde-373d69190430 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:10.943903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949adf7-598d-47f1-acde-373d69190430 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:10.944073 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949adf7-598d-47f1-acde-373d69190430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:11.020141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-2949adf7-598d-47f1-acde-373d69190430 None None] MFA Rules not processed for user `54d2608c7c8e4d7581fd9a944d8f18e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:11.022204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2949adf7-598d-47f1-acde-373d69190430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:11.058791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 931/1875] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:11.064528 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51794c92-05e4-44d0-ac6f-d97757027dab None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:11.096845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:11.145029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 945/1876] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:11.160460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:11.186541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949adf7-598d-47f1-acde-373d69190430 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:11.189157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2949adf7-598d-47f1-acde-373d69190430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:11.225804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51794c92-05e4-44d0-ac6f-d97757027dab None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:11.233611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ee9b4-5de9-4812-a3b9-9a7114a2706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:11.234924 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ee9b4-5de9-4812-a3b9-9a7114a2706b admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:11.235976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ee9b4-5de9-4812-a3b9-9a7114a2706b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:11.236335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ee9b4-5de9-4812-a3b9-9a7114a2706b admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:11.237742 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ee9b4-5de9-4812-a3b9-9a7114a2706b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:11.248646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ee9b4-5de9-4812-a3b9-9a7114a2706b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:11.307154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 932/1877] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:11 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:22:11.308525 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ee9b4-5de9-4812-a3b9-9a7114a2706b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:11.355788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949adf7-598d-47f1-acde-373d69190430 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:11.421299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ee9b4-5de9-4812-a3b9-9a7114a2706b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:11.427977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026555-044f-4d3b-974c-502583cdccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:11.428726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026555-044f-4d3b-974c-502583cdccb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:11.429428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026555-044f-4d3b-974c-502583cdccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:11.429799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026555-044f-4d3b-974c-502583cdccb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:11.430543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69026555-044f-4d3b-974c-502583cdccb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:11.432834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69026555-044f-4d3b-974c-502583cdccb6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:11.465360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 933/1878] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:11 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:11.469411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026555-044f-4d3b-974c-502583cdccb6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:11.472626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94929b8d-8c59-46ac-b4da-c42400952371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:11.473305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94929b8d-8c59-46ac-b4da-c42400952371 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:11.473645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94929b8d-8c59-46ac-b4da-c42400952371 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:11.474082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94929b8d-8c59-46ac-b4da-c42400952371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:11.480297 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026555-044f-4d3b-974c-502583cdccb6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:11.485492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78fa68-7bb6-4181-ba15-114c563ec586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:11.486164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78fa68-7bb6-4181-ba15-114c563ec586 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:11.486562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78fa68-7bb6-4181-ba15-114c563ec586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:11.486833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78fa68-7bb6-4181-ba15-114c563ec586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:11.487509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78fa68-7bb6-4181-ba15-114c563ec586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:11.489310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78fa68-7bb6-4181-ba15-114c563ec586 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:11.514797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 934/1879] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:22:11.515849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78fa68-7bb6-4181-ba15-114c563ec586 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:11.548620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94929b8d-8c59-46ac-b4da-c42400952371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:11.550325 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78fa68-7bb6-4181-ba15-114c563ec586 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:11.550593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94929b8d-8c59-46ac-b4da-c42400952371 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:11.559121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c77f5-c357-48cc-8837-a91a2bf2de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:11.560019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c77f5-c357-48cc-8837-a91a2bf2de4e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:11.560427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c77f5-c357-48cc-8837-a91a2bf2de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:11.560759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c77f5-c357-48cc-8837-a91a2bf2de4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:11.561563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c77f5-c357-48cc-8837-a91a2bf2de4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:11.562275 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 946/1880] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:22:11.563859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c77f5-c357-48cc-8837-a91a2bf2de4e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:11.582571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 935/1881] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:11.584595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94929b8d-8c59-46ac-b4da-c42400952371 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:11.598794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94929b8d-8c59-46ac-b4da-c42400952371 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:11.603601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6eea7-424e-42ae-850c-09cbfb87ae8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:11.604206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6eea7-424e-42ae-850c-09cbfb87ae8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:11.604484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6eea7-424e-42ae-850c-09cbfb87ae8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:11.604759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6eea7-424e-42ae-850c-09cbfb87ae8e admin admin] PATH_INFO: `/v3/projects/c30df64c9d8c49fe85f4a8ed4732dca4/users/4d377cbed0384e088461abc9c8663366/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:11.633675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6eea7-424e-42ae-850c-09cbfb87ae8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30df64c9d8c49fe85f4a8ed4732dca4, user_id=4d377cbed0384e088461abc9c8663366, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:11.636703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6eea7-424e-42ae-850c-09cbfb87ae8e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:11.655303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 947/1882] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:11 2022] PUT /identity/v3/projects/c30df64c9d8c49fe85f4a8ed4732dca4/users/4d377cbed0384e088461abc9c8663366/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:11.666767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f278ae5-4094-4c29-96da-f085e3d4ebae None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:11.667312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f278ae5-4094-4c29-96da-f085e3d4ebae None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:11.667416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f278ae5-4094-4c29-96da-f085e3d4ebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:11.714355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1f278ae5-4094-4c29-96da-f085e3d4ebae None None] MFA Rules not processed for user `4d377cbed0384e088461abc9c8663366`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:11.715387 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1f278ae5-4094-4c29-96da-f085e3d4ebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:11.820867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 936/1883] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:11.828114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6eea7-424e-42ae-850c-09cbfb87ae8e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:11.834885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:11.923282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6eea7-424e-42ae-850c-09cbfb87ae8e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:11.932072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576a1f7-4e39-4002-b6ab-e820a3eb1c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:11.933011 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576a1f7-4e39-4002-b6ab-e820a3eb1c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:11.933379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576a1f7-4e39-4002-b6ab-e820a3eb1c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:11.933668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576a1f7-4e39-4002-b6ab-e820a3eb1c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:11.934433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576a1f7-4e39-4002-b6ab-e820a3eb1c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:11.938547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576a1f7-4e39-4002-b6ab-e820a3eb1c05 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:11.976158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 948/1884] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:11 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:11.980460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f278ae5-4094-4c29-96da-f085e3d4ebae None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:11.993750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f278ae5-4094-4c29-96da-f085e3d4ebae None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:12.011676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:12.102039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009176e5-ed32-4029-82f9-e8eacde2b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:12.102675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009176e5-ed32-4029-82f9-e8eacde2b1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:12.103025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009176e5-ed32-4029-82f9-e8eacde2b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:12.103436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009176e5-ed32-4029-82f9-e8eacde2b1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:12.104259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009176e5-ed32-4029-82f9-e8eacde2b1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:12.106251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009176e5-ed32-4029-82f9-e8eacde2b1f1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:12.132143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 937/1885] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:11 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:22:12.136144 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576a1f7-4e39-4002-b6ab-e820a3eb1c05 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:12.149291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576a1f7-4e39-4002-b6ab-e820a3eb1c05 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:12.156694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122a25e-ae20-4d21-bd9a-616e03eaa02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:12.157705 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122a25e-ae20-4d21-bd9a-616e03eaa02d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:12.158050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122a25e-ae20-4d21-bd9a-616e03eaa02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:12.158496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122a25e-ae20-4d21-bd9a-616e03eaa02d admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:12.159419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122a25e-ae20-4d21-bd9a-616e03eaa02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:12.162488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122a25e-ae20-4d21-bd9a-616e03eaa02d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:12.177809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 949/1886] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:12.183471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009176e5-ed32-4029-82f9-e8eacde2b1f1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:12.207870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009176e5-ed32-4029-82f9-e8eacde2b1f1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:12.213351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c337d7-8bbd-468b-a790-ad97ea6fb2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:12.214273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c337d7-8bbd-468b-a790-ad97ea6fb2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:12.214667 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c337d7-8bbd-468b-a790-ad97ea6fb2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:12.215045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c337d7-8bbd-468b-a790-ad97ea6fb2bd admin admin] PATH_INFO: `/v3/projects/eec5595bab54497bbf1b8ab36fbe1c6e/users/de8357b484834fb59e575c584138f938/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:12.233561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c337d7-8bbd-468b-a790-ad97ea6fb2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec5595bab54497bbf1b8ab36fbe1c6e, user_id=de8357b484834fb59e575c584138f938, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:12.236995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c337d7-8bbd-468b-a790-ad97ea6fb2bd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:12.257058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 938/1887] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:12 2022] PUT /identity/v3/projects/eec5595bab54497bbf1b8ab36fbe1c6e/users/de8357b484834fb59e575c584138f938/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:12.258823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122a25e-ae20-4d21-bd9a-616e03eaa02d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:12.279010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122a25e-ae20-4d21-bd9a-616e03eaa02d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:12.343210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626ce34-c98c-411a-b579-cb7d809aaaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:12.343926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ce34-c98c-411a-b579-cb7d809aaaca admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:12.344204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ce34-c98c-411a-b579-cb7d809aaaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:12.344477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ce34-c98c-411a-b579-cb7d809aaaca admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:12.345115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626ce34-c98c-411a-b579-cb7d809aaaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:12.346786 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626ce34-c98c-411a-b579-cb7d809aaaca admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:12.361226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 950/1888] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:12.363228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c337d7-8bbd-468b-a790-ad97ea6fb2bd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:12.373822 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c337d7-8bbd-468b-a790-ad97ea6fb2bd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:12.379612 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178a01e-ab85-4125-b6b3-28ebac1e3ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:12.380296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178a01e-ab85-4125-b6b3-28ebac1e3ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:12.380630 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178a01e-ab85-4125-b6b3-28ebac1e3ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:12.380884 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178a01e-ab85-4125-b6b3-28ebac1e3ec7 admin admin] PATH_INFO: `/v3/projects/eec5595bab54497bbf1b8ab36fbe1c6e/users/de8357b484834fb59e575c584138f938/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:12.383817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178a01e-ab85-4125-b6b3-28ebac1e3ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec5595bab54497bbf1b8ab36fbe1c6e, user_id=de8357b484834fb59e575c584138f938, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:12.386900 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178a01e-ab85-4125-b6b3-28ebac1e3ec7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:12.399522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 939/1889] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:12 2022] PUT /identity/v3/projects/eec5595bab54497bbf1b8ab36fbe1c6e/users/de8357b484834fb59e575c584138f938/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:12.411018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1ea8b-3f86-4b97-8bb6-a59991ed0976 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:12.411375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1ea8b-3f86-4b97-8bb6-a59991ed0976 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:12.411717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1ea8b-3f86-4b97-8bb6-a59991ed0976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:12.442235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d2d1ea8b-3f86-4b97-8bb6-a59991ed0976 None None] MFA Rules not processed for user `de8357b484834fb59e575c584138f938`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:12.443672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d2d1ea8b-3f86-4b97-8bb6-a59991ed0976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:12.530366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:12.546939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 951/1890] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:12.559384 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178a01e-ab85-4125-b6b3-28ebac1e3ec7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:12.561194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d178a01e-ab85-4125-b6b3-28ebac1e3ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:12.673924 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178a01e-ab85-4125-b6b3-28ebac1e3ec7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:12.679675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e4c16-3cf2-49b0-be60-ef3806adff64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:12.680701 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4c16-3cf2-49b0-be60-ef3806adff64 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:12.681192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4c16-3cf2-49b0-be60-ef3806adff64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:12.681691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4c16-3cf2-49b0-be60-ef3806adff64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:12.692875 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4c16-3cf2-49b0-be60-ef3806adff64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:12.695482 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4c16-3cf2-49b0-be60-ef3806adff64 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:12.708472 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 940/1891] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:12.769662 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1ea8b-3f86-4b97-8bb6-a59991ed0976 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:12.771427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d2d1ea8b-3f86-4b97-8bb6-a59991ed0976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:12.789119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1ea8b-3f86-4b97-8bb6-a59991ed0976 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:12.793317 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d2417-05d1-4c8c-9a41-40ebc3e35d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:12.794104 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d2417-05d1-4c8c-9a41-40ebc3e35d4f service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:12.794525 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d2417-05d1-4c8c-9a41-40ebc3e35d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:12.794969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d2417-05d1-4c8c-9a41-40ebc3e35d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:12.901196 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d2417-05d1-4c8c-9a41-40ebc3e35d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:12.902715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d2417-05d1-4c8c-9a41-40ebc3e35d4f service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:12.913815 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 952/1892] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:14.030499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18a58c-f398-460f-bf0e-f3cf80e965d0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:14.031074 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18a58c-f398-460f-bf0e-f3cf80e965d0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:14.031074 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18a58c-f398-460f-bf0e-f3cf80e965d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:14.050754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9e18a58c-f398-460f-bf0e-f3cf80e965d0 None None] MFA Rules not processed for user `54d2608c7c8e4d7581fd9a944d8f18e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:14.052389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9e18a58c-f398-460f-bf0e-f3cf80e965d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:14.121449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 941/1893] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:16.552059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d2417-05d1-4c8c-9a41-40ebc3e35d4f service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:16.618021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d2417-05d1-4c8c-9a41-40ebc3e35d4f service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:16.624616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:16.625864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:16.626146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:16.626427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] PATH_INFO: `/v3/users/34cf87904b704b0ab68e545acc864c8f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:16.627669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cf87904b704b0ab68e545acc864c8f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:16.629935 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:16.725405 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cf87904b704b0ab68e545acc864c8f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:16.725823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cf87904b704b0ab68e545acc864c8f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:16.735173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cf87904b704b0ab68e545acc864c8f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:16.747467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cf87904b704b0ab68e545acc864c8f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:16.748365 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cf87904b704b0ab68e545acc864c8f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:16.774064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847e9ab-9102-4e37-9cc8-fe360ac4e136 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:16.775383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847e9ab-9102-4e37-9cc8-fe360ac4e136 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:16.775899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847e9ab-9102-4e37-9cc8-fe360ac4e136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:16.780035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 953/1894] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:16 2022] DELETE /identity/v3/users/34cf87904b704b0ab68e545acc864c8f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:16.800380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3847e9ab-9102-4e37-9cc8-fe360ac4e136 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:16.803105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3847e9ab-9102-4e37-9cc8-fe360ac4e136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:16.819209 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:16.951836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 942/1895] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:16.968148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:16.973214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:17.033452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:17.112259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52ec0f-89b2-4424-bb83-54ef0d4ee9ab admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:17.121532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518be4a-77c0-402e-aa89-40d0606653e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:17.122173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518be4a-77c0-402e-aa89-40d0606653e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:17.122453 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518be4a-77c0-402e-aa89-40d0606653e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:17.122725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518be4a-77c0-402e-aa89-40d0606653e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:17.152246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518be4a-77c0-402e-aa89-40d0606653e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:17.154072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518be4a-77c0-402e-aa89-40d0606653e8 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:17.163040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847e9ab-9102-4e37-9cc8-fe360ac4e136 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:17.165450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3847e9ab-9102-4e37-9cc8-fe360ac4e136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:17.181258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 954/1896] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:17.184666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847e9ab-9102-4e37-9cc8-fe360ac4e136 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:17.189202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:17.189837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:17.190114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:17.190383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] PATH_INFO: `/v3/users/a8836f28494a471cbf6cbc840c67bdfc` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:17.191547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8836f28494a471cbf6cbc840c67bdfc)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:17.193471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:17.251839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8836f28494a471cbf6cbc840c67bdfc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:17.260370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8836f28494a471cbf6cbc840c67bdfc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:17.271944 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8836f28494a471cbf6cbc840c67bdfc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:17.287479 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8836f28494a471cbf6cbc840c67bdfc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:17.289141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8836f28494a471cbf6cbc840c67bdfc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:17.302752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 943/1897] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:17 2022] DELETE /identity/v3/users/a8836f28494a471cbf6cbc840c67bdfc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:17.304701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452487d4-7259-4b51-bc48-771f053fc1f7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:17.304992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452487d4-7259-4b51-bc48-771f053fc1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:17.305322 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452487d4-7259-4b51-bc48-771f053fc1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:17.326178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-452487d4-7259-4b51-bc48-771f053fc1f7 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:17.327934 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-452487d4-7259-4b51-bc48-771f053fc1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:17.398786 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 955/1898] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:17.422972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:17.424483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:17.493318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596094cb-7ab3-4909-b15c-8e682dbb9bba admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:17.497468 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e749d5b-f314-4e71-995a-0264e22858e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:17.498230 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749d5b-f314-4e71-995a-0264e22858e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:17.498966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749d5b-f314-4e71-995a-0264e22858e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:17.498966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749d5b-f314-4e71-995a-0264e22858e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:17.512582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e749d5b-f314-4e71-995a-0264e22858e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:17.514214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e749d5b-f314-4e71-995a-0264e22858e3 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:17.535705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 944/1899] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:17.745407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452487d4-7259-4b51-bc48-771f053fc1f7 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:17.746425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-452487d4-7259-4b51-bc48-771f053fc1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:17.759953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452487d4-7259-4b51-bc48-771f053fc1f7 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:17.764775 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:17.765428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:17.766281 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:17.766568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] PATH_INFO: `/v3/projects/c6d1d5b4afb14300bd85070cc9220570` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:17.767913 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d1d5b4afb14300bd85070cc9220570)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:17.769847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:17.828974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d1d5b4afb14300bd85070cc9220570', 'request_id': 'req-39abaaf0-73e9-40bc-8c76-7d225514aefa'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:17.836949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d1d5b4afb14300bd85070cc9220570', 'request_id': 'req-39abaaf0-73e9-40bc-8c76-7d225514aefa'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:17.846932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d1d5b4afb14300bd85070cc9220570', 'request_id': 'req-39abaaf0-73e9-40bc-8c76-7d225514aefa'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:17.860875 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] The token cache is being invalidate because project c6d1d5b4afb14300bd85070cc9220570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:17.861226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:17.861992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:17.863895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 956/1900] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:17 2022] DELETE /identity/v3/projects/c6d1d5b4afb14300bd85070cc9220570 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:17.867999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e749d5b-f314-4e71-995a-0264e22858e3 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:17.882287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e749d5b-f314-4e71-995a-0264e22858e3 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:17.912361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:17.966520 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:17.967174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:17.967480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:17.967753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] PATH_INFO: `/v3/users/4d377cbed0384e088461abc9c8663366` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:17.969826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d377cbed0384e088461abc9c8663366)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:17.971890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:18.051510 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d377cbed0384e088461abc9c8663366'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.078458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d377cbed0384e088461abc9c8663366'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.095360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d377cbed0384e088461abc9c8663366'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.129530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d377cbed0384e088461abc9c8663366'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.129530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d377cbed0384e088461abc9c8663366'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.149511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 945/1901] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:17 2022] DELETE /identity/v3/users/4d377cbed0384e088461abc9c8663366 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:18.567923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:18.569380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:18.585151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abaaf0-73e9-40bc-8c76-7d225514aefa admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:18.643195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:18.686702 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:18.687915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:18.688303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:18.688471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] PATH_INFO: `/v3/projects/386d113bdf914b08b9dd679d6efac8cc` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:18.692368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386d113bdf914b08b9dd679d6efac8cc)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:18.692368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:18.693820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:18.695361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:18.716832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39209449-89d2-4e06-b9e8-8ba0dc60e368 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:18.721744 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:18.722736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:18.723021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:18.723321 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] PATH_INFO: `/v3/projects/c30df64c9d8c49fe85f4a8ed4732dca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:18.724475 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30df64c9d8c49fe85f4a8ed4732dca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:18.726791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:18.779689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386d113bdf914b08b9dd679d6efac8cc', 'request_id': 'req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.792383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386d113bdf914b08b9dd679d6efac8cc', 'request_id': 'req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.798500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30df64c9d8c49fe85f4a8ed4732dca4', 'request_id': 'req-f75f40a0-5fb4-45a3-9524-a614dec80ead'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.803529 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386d113bdf914b08b9dd679d6efac8cc', 'request_id': 'req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.817251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30df64c9d8c49fe85f4a8ed4732dca4', 'request_id': 'req-f75f40a0-5fb4-45a3-9524-a614dec80ead'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.827611 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] The token cache is being invalidate because project 386d113bdf914b08b9dd679d6efac8cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:18.828074 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.828820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e586deb1-830b-4828-a8c4-6e9a44e1d2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.828948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30df64c9d8c49fe85f4a8ed4732dca4', 'request_id': 'req-f75f40a0-5fb4-45a3-9524-a614dec80ead'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.830764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 957/1902] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:18 2022] DELETE /identity/v3/projects/386d113bdf914b08b9dd679d6efac8cc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:18.835907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3e6cd-1fa2-4689-93fd-651f30154b70 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:18.836530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3e6cd-1fa2-4689-93fd-651f30154b70 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:18.837052 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3e6cd-1fa2-4689-93fd-651f30154b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:18.847914 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] The token cache is being invalidate because project c30df64c9d8c49fe85f4a8ed4732dca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:18.848209 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.848957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:18.850671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 946/1903] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:18 2022] DELETE /identity/v3/projects/c30df64c9d8c49fe85f4a8ed4732dca4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:18.854501 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:18.858026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:18.869294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a8c3e6cd-1fa2-4689-93fd-651f30154b70 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:18.870975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a8c3e6cd-1fa2-4689-93fd-651f30154b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:18.910321 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:18.939040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 958/1904] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:18.945017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f40a0-5fb4-45a3-9524-a614dec80ead admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:18.947782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef376-b25e-4524-93d3-f4fdb1b3ed75 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:18.948070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef376-b25e-4524-93d3-f4fdb1b3ed75 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:18.948347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef376-b25e-4524-93d3-f4fdb1b3ed75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:18.950038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:18.951065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:18.951377 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:18.951657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] PATH_INFO: `/v3/users/de8357b484834fb59e575c584138f938` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:18.953014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8357b484834fb59e575c584138f938)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:18.955116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:18.970119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0a8ef376-b25e-4524-93d3-f4fdb1b3ed75 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:18.971405 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0a8ef376-b25e-4524-93d3-f4fdb1b3ed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:18.980212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 959/1905] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:18.985807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ef376-b25e-4524-93d3-f4fdb1b3ed75 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:18.996567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ef376-b25e-4524-93d3-f4fdb1b3ed75 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:19.002761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd1628-4791-41cd-8b1d-b295fdb7fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:19.003661 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd1628-4791-41cd-8b1d-b295fdb7fb8d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:19.003945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd1628-4791-41cd-8b1d-b295fdb7fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:19.004304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd1628-4791-41cd-8b1d-b295fdb7fb8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:19.005073 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd1628-4791-41cd-8b1d-b295fdb7fb8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:19.005451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd1628-4791-41cd-8b1d-b295fdb7fb8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:19.007262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd1628-4791-41cd-8b1d-b295fdb7fb8d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:19.027864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 960/1906] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:22:19.034246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8357b484834fb59e575c584138f938'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:19.038376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd1628-4791-41cd-8b1d-b295fdb7fb8d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:19.045031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8357b484834fb59e575c584138f938'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:19.075239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8357b484834fb59e575c584138f938'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:19.079703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd1628-4791-41cd-8b1d-b295fdb7fb8d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:19.085462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50901a2-6c17-465e-b79c-d2f0645adadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:19.085962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50901a2-6c17-465e-b79c-d2f0645adadb admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:19.086725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50901a2-6c17-465e-b79c-d2f0645adadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:19.087081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50901a2-6c17-465e-b79c-d2f0645adadb admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:19.087870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50901a2-6c17-465e-b79c-d2f0645adadb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:19.089875 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50901a2-6c17-465e-b79c-d2f0645adadb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:19.096055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8357b484834fb59e575c584138f938'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:19.097340 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8357b484834fb59e575c584138f938'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:19.104754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 947/1907] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:18 2022] DELETE /identity/v3/users/de8357b484834fb59e575c584138f938 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:19.139070 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 961/1908] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:19 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:19.144077 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:19.146611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:19.285792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca74e23-9cca-48c4-a7f2-fbf328d8680b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:19.358594 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:19.366969 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a541e2-50b1-4e6b-8e9d-5a7c74b239e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:19.368133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a541e2-50b1-4e6b-8e9d-5a7c74b239e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:19.368693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a541e2-50b1-4e6b-8e9d-5a7c74b239e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:19.370090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a541e2-50b1-4e6b-8e9d-5a7c74b239e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:19.370846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a541e2-50b1-4e6b-8e9d-5a7c74b239e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:19.373554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a541e2-50b1-4e6b-8e9d-5a7c74b239e2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:19.411445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 948/1909] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:19 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:19.413355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50901a2-6c17-465e-b79c-d2f0645adadb admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:19.425288 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50901a2-6c17-465e-b79c-d2f0645adadb admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:19.430550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156392a-77f8-4d38-826f-5c64bfacd56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:19.431051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156392a-77f8-4d38-826f-5c64bfacd56a admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:19.431366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156392a-77f8-4d38-826f-5c64bfacd56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:19.431865 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156392a-77f8-4d38-826f-5c64bfacd56a admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:19.432278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156392a-77f8-4d38-826f-5c64bfacd56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:19.433911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156392a-77f8-4d38-826f-5c64bfacd56a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:19.444750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 962/1910] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:19.448478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a541e2-50b1-4e6b-8e9d-5a7c74b239e2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:19.459998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a541e2-50b1-4e6b-8e9d-5a7c74b239e2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:19.465441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c3474-52ae-4d76-b0cf-8858cbd31713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:19.466064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c3474-52ae-4d76-b0cf-8858cbd31713 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:19.466373 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c3474-52ae-4d76-b0cf-8858cbd31713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:19.466623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c3474-52ae-4d76-b0cf-8858cbd31713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:19.467434 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c3474-52ae-4d76-b0cf-8858cbd31713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:19.469457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c3474-52ae-4d76-b0cf-8858cbd31713 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:19.485837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 949/1911] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:19.492679 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156392a-77f8-4d38-826f-5c64bfacd56a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:19.510548 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156392a-77f8-4d38-826f-5c64bfacd56a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:19.516919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854446f2-a505-49e5-b1d1-8fb1c3a3462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:19.517295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854446f2-a505-49e5-b1d1-8fb1c3a3462e admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:19.517574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854446f2-a505-49e5-b1d1-8fb1c3a3462e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:19.517932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854446f2-a505-49e5-b1d1-8fb1c3a3462e admin admin] PATH_INFO: `/v3/projects/29ec8e0fc7bc4b04821d9b29ed5fadcf/users/0666947b1fb74faaba1b136abd0f426b/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:19.537912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854446f2-a505-49e5-b1d1-8fb1c3a3462e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ec8e0fc7bc4b04821d9b29ed5fadcf, user_id=0666947b1fb74faaba1b136abd0f426b, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:19.541449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854446f2-a505-49e5-b1d1-8fb1c3a3462e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:19.545650 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:19.561440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c3474-52ae-4d76-b0cf-8858cbd31713 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:19.563596 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-431c3474-52ae-4d76-b0cf-8858cbd31713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:19.583584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c3474-52ae-4d76-b0cf-8858cbd31713 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:19.587549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 963/1912] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:19 2022] PUT /identity/v3/projects/29ec8e0fc7bc4b04821d9b29ed5fadcf/users/0666947b1fb74faaba1b136abd0f426b/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:19.598810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6a4e-1fec-4806-8c77-0b18ccad519d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:19.599175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6a4e-1fec-4806-8c77-0b18ccad519d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:19.599533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6a4e-1fec-4806-8c77-0b18ccad519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:19.649832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ab7a6a4e-1fec-4806-8c77-0b18ccad519d None None] MFA Rules not processed for user `0666947b1fb74faaba1b136abd0f426b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:19.651057 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ab7a6a4e-1fec-4806-8c77-0b18ccad519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:19.670005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:19.671990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:19.672282 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:19.672555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] PATH_INFO: `/v3/projects/eec5595bab54497bbf1b8ab36fbe1c6e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:19.675538 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec5595bab54497bbf1b8ab36fbe1c6e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:19.677503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:19.750046 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 964/1913] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:19.767867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6a4e-1fec-4806-8c77-0b18ccad519d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:19.782037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ab7a6a4e-1fec-4806-8c77-0b18ccad519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:19.783846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec5595bab54497bbf1b8ab36fbe1c6e', 'request_id': 'req-f2af34ac-a55c-470f-8593-3872883ef191'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:19.806411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec5595bab54497bbf1b8ab36fbe1c6e', 'request_id': 'req-f2af34ac-a55c-470f-8593-3872883ef191'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:19.818824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec5595bab54497bbf1b8ab36fbe1c6e', 'request_id': 'req-f2af34ac-a55c-470f-8593-3872883ef191'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:19.856136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] The token cache is being invalidate because project eec5595bab54497bbf1b8ab36fbe1c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:19.856431 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:19.857741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f2af34ac-a55c-470f-8593-3872883ef191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:19.864854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 950/1914] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:19 2022] DELETE /identity/v3/projects/eec5595bab54497bbf1b8ab36fbe1c6e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:19.869616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f44ffc-5192-4203-9b60-649d3187333e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:19.869977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f44ffc-5192-4203-9b60-649d3187333e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:19.870183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f44ffc-5192-4203-9b60-649d3187333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:19.907283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6a4e-1fec-4806-8c77-0b18ccad519d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:19.921719 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-55f44ffc-5192-4203-9b60-649d3187333e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:19.923823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-55f44ffc-5192-4203-9b60-649d3187333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:20.009036 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe89720-46ae-4c7e-af15-19706488d773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:20.009948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe89720-46ae-4c7e-af15-19706488d773 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:20.010434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe89720-46ae-4c7e-af15-19706488d773 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:20.010923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe89720-46ae-4c7e-af15-19706488d773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:20.012948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9fe89720-46ae-4c7e-af15-19706488d773 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:20.027422 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 951/1915] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:20.030861 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea8ee6-cc77-4c0e-ad75-1959b0bb44af None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:20.031616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea8ee6-cc77-4c0e-ad75-1959b0bb44af None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:20.032805 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea8ee6-cc77-4c0e-ad75-1959b0bb44af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:20.068150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:20.076421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6bea8ee6-cc77-4c0e-ad75-1959b0bb44af None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:20.080993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6bea8ee6-cc77-4c0e-ad75-1959b0bb44af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:20.089859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 952/1916] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:20.094292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea8ee6-cc77-4c0e-ad75-1959b0bb44af None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:20.115524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea8ee6-cc77-4c0e-ad75-1959b0bb44af None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:20.128810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe5470-02ab-49cc-b3f5-afc84520d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:20.131458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe5470-02ab-49cc-b3f5-afc84520d84d admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:20.132048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe5470-02ab-49cc-b3f5-afc84520d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:20.132791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe5470-02ab-49cc-b3f5-afc84520d84d admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:20.133679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe5470-02ab-49cc-b3f5-afc84520d84d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:20.134392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe5470-02ab-49cc-b3f5-afc84520d84d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:20.136237 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe5470-02ab-49cc-b3f5-afc84520d84d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:20.141778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:20.147080 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe89720-46ae-4c7e-af15-19706488d773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:20.148999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe89720-46ae-4c7e-af15-19706488d773 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:20.158154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 953/1917] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:22:20.164362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe5470-02ab-49cc-b3f5-afc84520d84d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:20.164603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 965/1918] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:20.178294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe5470-02ab-49cc-b3f5-afc84520d84d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:20.186125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b63c34-de64-4e0f-94b4-fae5e67d198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:20.187250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b63c34-de64-4e0f-94b4-fae5e67d198c admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:20.188189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b63c34-de64-4e0f-94b4-fae5e67d198c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:20.188435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b63c34-de64-4e0f-94b4-fae5e67d198c admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:20.189197 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b63c34-de64-4e0f-94b4-fae5e67d198c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:20.191238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b63c34-de64-4e0f-94b4-fae5e67d198c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:20.272794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 954/1919] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:20 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:20.274179 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe89720-46ae-4c7e-af15-19706488d773 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:20.286970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe89720-46ae-4c7e-af15-19706488d773 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:20.372293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485049-fa83-4cb8-aec5-4d90a11db938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:20.372921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485049-fa83-4cb8-aec5-4d90a11db938 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:20.373205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485049-fa83-4cb8-aec5-4d90a11db938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:20.373587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485049-fa83-4cb8-aec5-4d90a11db938 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:20.374539 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1485049-fa83-4cb8-aec5-4d90a11db938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:20.377919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1485049-fa83-4cb8-aec5-4d90a11db938 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:20.409536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 966/1920] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:20 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:20.410894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b63c34-de64-4e0f-94b4-fae5e67d198c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:20.422402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b63c34-de64-4e0f-94b4-fae5e67d198c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:20.427126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ee642-150b-434f-b291-7d5ce957fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:20.427901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ee642-150b-434f-b291-7d5ce957fd0c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:20.428183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ee642-150b-434f-b291-7d5ce957fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:20.428459 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ee642-150b-434f-b291-7d5ce957fd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:20.429102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ee642-150b-434f-b291-7d5ce957fd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:20.430704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ee642-150b-434f-b291-7d5ce957fd0c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:20.441493 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 955/1921] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:20.445637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485049-fa83-4cb8-aec5-4d90a11db938 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:20.456810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485049-fa83-4cb8-aec5-4d90a11db938 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:20.462286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff65d05-0c79-4bc6-aeee-2852377e4998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:20.462841 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65d05-0c79-4bc6-aeee-2852377e4998 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:20.463124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65d05-0c79-4bc6-aeee-2852377e4998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:20.463432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65d05-0c79-4bc6-aeee-2852377e4998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:20.464078 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff65d05-0c79-4bc6-aeee-2852377e4998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:20.465660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff65d05-0c79-4bc6-aeee-2852377e4998 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:20.476996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 967/1922] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:20.481098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ee642-150b-434f-b291-7d5ce957fd0c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:20.496093 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ee642-150b-434f-b291-7d5ce957fd0c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:20.500914 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc85723-643e-4a74-a416-8486aa9af951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:20.501611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc85723-643e-4a74-a416-8486aa9af951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:20.501891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc85723-643e-4a74-a416-8486aa9af951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:20.502167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc85723-643e-4a74-a416-8486aa9af951 admin admin] PATH_INFO: `/v3/projects/69f3d8231b4247c2b79b9efcd65ed333/users/f37cd4c6695e46bdb275b123793cac69/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:20.519435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc85723-643e-4a74-a416-8486aa9af951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f3d8231b4247c2b79b9efcd65ed333, user_id=f37cd4c6695e46bdb275b123793cac69, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:20.522283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc85723-643e-4a74-a416-8486aa9af951 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:20.537166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 956/1923] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:20 2022] PUT /identity/v3/projects/69f3d8231b4247c2b79b9efcd65ed333/users/f37cd4c6695e46bdb275b123793cac69/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:20.554238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0e81-1d7b-44d7-9432-f18e40cbb756 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:20.554820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0e81-1d7b-44d7-9432-f18e40cbb756 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:20.555211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0e81-1d7b-44d7-9432-f18e40cbb756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:20.606235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-691b0e81-1d7b-44d7-9432-f18e40cbb756 None None] MFA Rules not processed for user `f37cd4c6695e46bdb275b123793cac69`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:20.607929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-691b0e81-1d7b-44d7-9432-f18e40cbb756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:20.677561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 968/1924] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:20.690171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc85723-643e-4a74-a416-8486aa9af951 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:20.691926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dbc85723-643e-4a74-a416-8486aa9af951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:20.749328 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc85723-643e-4a74-a416-8486aa9af951 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:20.753517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b469c2a-90db-4182-ab04-958d633d3d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:20.754133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b469c2a-90db-4182-ab04-958d633d3d96 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:20.754417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b469c2a-90db-4182-ab04-958d633d3d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:20.754682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b469c2a-90db-4182-ab04-958d633d3d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:20.764245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b469c2a-90db-4182-ab04-958d633d3d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:20.766295 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b469c2a-90db-4182-ab04-958d633d3d96 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:20.775765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 957/1925] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:21.630840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8ce8a-6e4e-4fbe-b851-bc45b9e08f54 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:21.631532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8ce8a-6e4e-4fbe-b851-bc45b9e08f54 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:21.631532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8ce8a-6e4e-4fbe-b851-bc45b9e08f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:21.656568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-94b8ce8a-6e4e-4fbe-b851-bc45b9e08f54 None None] MFA Rules not processed for user `0666947b1fb74faaba1b136abd0f426b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:21.657989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-94b8ce8a-6e4e-4fbe-b851-bc45b9e08f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:21.726610 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 969/1926] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:30.771165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:31.718146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:33.224478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b469c2a-90db-4182-ab04-958d633d3d96 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:33.226365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3b469c2a-90db-4182-ab04-958d633d3d96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:33.294998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b469c2a-90db-4182-ab04-958d633d3d96 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:33.300554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:33.301351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:33.301634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:33.301909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] PATH_INFO: `/v3/users/7a9aed298d8748ec9da67897318c8405` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:33.303049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9aed298d8748ec9da67897318c8405)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:33.305048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:33.350582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9aed298d8748ec9da67897318c8405'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.357484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9aed298d8748ec9da67897318c8405'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.366640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9aed298d8748ec9da67897318c8405'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.380550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9aed298d8748ec9da67897318c8405'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.381263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9aed298d8748ec9da67897318c8405'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.387334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 958/1927] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:33 2022] DELETE /identity/v3/users/7a9aed298d8748ec9da67897318c8405 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:33.539418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8ce8a-6e4e-4fbe-b851-bc45b9e08f54 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:33.564230 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8ce8a-6e4e-4fbe-b851-bc45b9e08f54 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:33.592095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:33.598598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:33.674997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:33.675978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:33.676268 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:33.676547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] PATH_INFO: `/v3/users/f37cd4c6695e46bdb275b123793cac69` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:33.677728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37cd4c6695e46bdb275b123793cac69)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:33.679688 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:33.724977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef28b9e-86da-4f71-90af-e1d2c24c84c2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:33.730657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:33.737012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:33.737012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:33.737012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] PATH_INFO: `/v3/projects/6c33909a6b4f4e3396ad0c14fe5bc9d6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:33.737012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c33909a6b4f4e3396ad0c14fe5bc9d6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:33.737493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37cd4c6695e46bdb275b123793cac69'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.737493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37cd4c6695e46bdb275b123793cac69'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.738127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:33.748679 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37cd4c6695e46bdb275b123793cac69'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.757330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37cd4c6695e46bdb275b123793cac69'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.758240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-94d19e7b-aab0-45b3-bfd2-3163aaecce3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37cd4c6695e46bdb275b123793cac69'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.771326 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:33.777614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 970/1928] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:33 2022] DELETE /identity/v3/users/f37cd4c6695e46bdb275b123793cac69 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:33.782760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3c1b4-120e-4c26-9a24-dac5259026ed None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:33.783056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3c1b4-120e-4c26-9a24-dac5259026ed None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:33.783364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3c1b4-120e-4c26-9a24-dac5259026ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:33.806615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c33909a6b4f4e3396ad0c14fe5bc9d6', 'request_id': 'req-ae1763e8-9fc2-4253-8110-56c3eec6e983'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.812124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a7b3c1b4-120e-4c26-9a24-dac5259026ed None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:33.813974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a7b3c1b4-120e-4c26-9a24-dac5259026ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:33.816016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c33909a6b4f4e3396ad0c14fe5bc9d6', 'request_id': 'req-ae1763e8-9fc2-4253-8110-56c3eec6e983'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.838241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c33909a6b4f4e3396ad0c14fe5bc9d6', 'request_id': 'req-ae1763e8-9fc2-4253-8110-56c3eec6e983'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.859662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] The token cache is being invalidate because project 6c33909a6b4f4e3396ad0c14fe5bc9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:33.859961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.860804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:33.864147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 959/1929] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:33 2022] DELETE /identity/v3/projects/6c33909a6b4f4e3396ad0c14fe5bc9d6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:33.867972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:33.871086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:33.910143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 971/1930] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:33.920770 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3c1b4-120e-4c26-9a24-dac5259026ed None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:33.924055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a7b3c1b4-120e-4c26-9a24-dac5259026ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:33.954433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:33.963079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1763e8-9fc2-4253-8110-56c3eec6e983 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:33.968647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:33.969291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:33.971533 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:33.971902 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] PATH_INFO: `/v3/users/e72e61a774034ccabf5337a76841ce1f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:33.973304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72e61a774034ccabf5337a76841ce1f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:33.975450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:33.996661 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3c1b4-120e-4c26-9a24-dac5259026ed None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:34.000989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece40488-ed93-4593-855f-a7eb41758147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:34.001603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece40488-ed93-4593-855f-a7eb41758147 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:34.001905 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece40488-ed93-4593-855f-a7eb41758147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:34.002258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece40488-ed93-4593-855f-a7eb41758147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:34.012509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece40488-ed93-4593-855f-a7eb41758147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:34.013939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece40488-ed93-4593-855f-a7eb41758147 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:34.023215 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 972/1931] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:34.024432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72e61a774034ccabf5337a76841ce1f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.031958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72e61a774034ccabf5337a76841ce1f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.040153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72e61a774034ccabf5337a76841ce1f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.072203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72e61a774034ccabf5337a76841ce1f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.073431 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72e61a774034ccabf5337a76841ce1f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.085334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 960/1932] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:33 2022] DELETE /identity/v3/users/e72e61a774034ccabf5337a76841ce1f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:34.293755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece40488-ed93-4593-855f-a7eb41758147 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:34.306694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece40488-ed93-4593-855f-a7eb41758147 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:34.373495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:34.374141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:34.374834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:34.375180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] PATH_INFO: `/v3/projects/052d481100ce4349af6a02a21468654b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:34.376409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] RBAC: Authorizing `identity:delete_project(project_id=052d481100ce4349af6a02a21468654b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:34.378966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:34.414794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:34.416650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:34.437921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052d481100ce4349af6a02a21468654b', 'request_id': 'req-655125be-aec2-4896-bace-c8dcfe25941d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.445066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052d481100ce4349af6a02a21468654b', 'request_id': 'req-655125be-aec2-4896-bace-c8dcfe25941d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.455220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052d481100ce4349af6a02a21468654b', 'request_id': 'req-655125be-aec2-4896-bace-c8dcfe25941d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.462848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c0dee-e6e9-4269-b35b-61304696f5a7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:34.469200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] The token cache is being invalidate because project 052d481100ce4349af6a02a21468654b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:34.469505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.470232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-655125be-aec2-4896-bace-c8dcfe25941d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.471821 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 973/1933] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:34 2022] DELETE /identity/v3/projects/052d481100ce4349af6a02a21468654b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:34.476443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4cc53-007b-4d64-9364-0423ef80e19a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:34.476736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4cc53-007b-4d64-9364-0423ef80e19a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:34.477004 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4cc53-007b-4d64-9364-0423ef80e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:34.489832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:34.499403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f3f4cc53-007b-4d64-9364-0423ef80e19a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:34.501450 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f3f4cc53-007b-4d64-9364-0423ef80e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:34.526219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:34.527198 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:34.527511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:34.527793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] PATH_INFO: `/v3/projects/69f3d8231b4247c2b79b9efcd65ed333` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:34.529001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f3d8231b4247c2b79b9efcd65ed333)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:34.531038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:34.552802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:34.569893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 974/1934] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:34.579145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad98de-cc68-4285-83d6-eeffe2714a99 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:34.579510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad98de-cc68-4285-83d6-eeffe2714a99 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:34.579759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad98de-cc68-4285-83d6-eeffe2714a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:34.583676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f3d8231b4247c2b79b9efcd65ed333', 'request_id': 'req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.592105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f3d8231b4247c2b79b9efcd65ed333', 'request_id': 'req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.598898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f3d8231b4247c2b79b9efcd65ed333', 'request_id': 'req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.602014 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0cad98de-cc68-4285-83d6-eeffe2714a99 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:34.603284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0cad98de-cc68-4285-83d6-eeffe2714a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:34.614134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] The token cache is being invalidate because project 69f3d8231b4247c2b79b9efcd65ed333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:34.614825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.615803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:34.618802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 961/1935] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:34 2022] DELETE /identity/v3/projects/69f3d8231b4247c2b79b9efcd65ed333 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:34.691788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 975/1936] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:34.708372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:34.721704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838cd40-5e95-4cb2-8433-5ca09e4cfb19 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:34.726568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8a69a-ec1d-47a1-8181-bea098efbf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:34.727319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a69a-ec1d-47a1-8181-bea098efbf6a admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:34.727609 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a69a-ec1d-47a1-8181-bea098efbf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:34.727939 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a69a-ec1d-47a1-8181-bea098efbf6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:34.728611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8a69a-ec1d-47a1-8181-bea098efbf6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:34.728917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8a69a-ec1d-47a1-8181-bea098efbf6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:34.731307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8a69a-ec1d-47a1-8181-bea098efbf6a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:34.744821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 962/1937] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:22:34.749186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad98de-cc68-4285-83d6-eeffe2714a99 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:34.760237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad98de-cc68-4285-83d6-eeffe2714a99 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:34.765020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fed28-451e-43bf-ba45-253b4bba22a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:34.766193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fed28-451e-43bf-ba45-253b4bba22a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:34.766468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fed28-451e-43bf-ba45-253b4bba22a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:34.766737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fed28-451e-43bf-ba45-253b4bba22a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:34.767423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fed28-451e-43bf-ba45-253b4bba22a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:34.769380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fed28-451e-43bf-ba45-253b4bba22a0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:34.807076 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 976/1938] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:34 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:34.816426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8a69a-ec1d-47a1-8181-bea098efbf6a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:34.828997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8a69a-ec1d-47a1-8181-bea098efbf6a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:34.891771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62544af-ed7a-45d1-88d0-2d963d202e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:34.892394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62544af-ed7a-45d1-88d0-2d963d202e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:34.892675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62544af-ed7a-45d1-88d0-2d963d202e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:34.892948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62544af-ed7a-45d1-88d0-2d963d202e4b admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:34.893706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62544af-ed7a-45d1-88d0-2d963d202e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:34.895746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62544af-ed7a-45d1-88d0-2d963d202e4b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:34.921700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 963/1939] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:34 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:22:34.923515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fed28-451e-43bf-ba45-253b4bba22a0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:34.934524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fed28-451e-43bf-ba45-253b4bba22a0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:34.939916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e59821-3089-4bd9-a339-44e7283ce492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:34.940623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59821-3089-4bd9-a339-44e7283ce492 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:34.940952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59821-3089-4bd9-a339-44e7283ce492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:34.941296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59821-3089-4bd9-a339-44e7283ce492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:34.942041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e59821-3089-4bd9-a339-44e7283ce492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:34.943833 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e59821-3089-4bd9-a339-44e7283ce492 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:34.961251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 977/1940] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:34.962718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62544af-ed7a-45d1-88d0-2d963d202e4b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:34.979887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62544af-ed7a-45d1-88d0-2d963d202e4b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:34.986563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b48616-d437-4a4b-9421-e5ba15f69257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:34.987181 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b48616-d437-4a4b-9421-e5ba15f69257 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:34.987495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b48616-d437-4a4b-9421-e5ba15f69257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:34.987763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b48616-d437-4a4b-9421-e5ba15f69257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:34.988499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b48616-d437-4a4b-9421-e5ba15f69257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:34.990114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b48616-d437-4a4b-9421-e5ba15f69257 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:35.001515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 964/1941] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:35.006427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e59821-3089-4bd9-a339-44e7283ce492 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:35.016505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e59821-3089-4bd9-a339-44e7283ce492 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:35.021316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195b8d8-5090-4067-948a-a4f3dd6b989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:35.021977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195b8d8-5090-4067-948a-a4f3dd6b989a admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:35.022741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195b8d8-5090-4067-948a-a4f3dd6b989a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:35.022741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195b8d8-5090-4067-948a-a4f3dd6b989a admin admin] PATH_INFO: `/v3/projects/864d7de405f645eb8ec013c1a00c1b45/users/5fa4b634e02d4042bade685e049a5b12/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:35.038701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195b8d8-5090-4067-948a-a4f3dd6b989a admin admin] RBAC: Authorizing `identity:create_grant(project_id=864d7de405f645eb8ec013c1a00c1b45, user_id=5fa4b634e02d4042bade685e049a5b12, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:35.041537 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195b8d8-5090-4067-948a-a4f3dd6b989a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:35.060256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 978/1942] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:35 2022] PUT /identity/v3/projects/864d7de405f645eb8ec013c1a00c1b45/users/5fa4b634e02d4042bade685e049a5b12/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:35.070424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04202f2f-237a-4050-8d35-3c90ce17f763 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:35.070717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04202f2f-237a-4050-8d35-3c90ce17f763 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:35.071000 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04202f2f-237a-4050-8d35-3c90ce17f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:35.110173 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-04202f2f-237a-4050-8d35-3c90ce17f763 None None] MFA Rules not processed for user `5fa4b634e02d4042bade685e049a5b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:35.111455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-04202f2f-237a-4050-8d35-3c90ce17f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:35.127258 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:35.194562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 965/1943] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:35.206163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195b8d8-5090-4067-948a-a4f3dd6b989a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:35.208819 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a195b8d8-5090-4067-948a-a4f3dd6b989a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:35.292465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195b8d8-5090-4067-948a-a4f3dd6b989a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:35.297172 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aeb50-e8cc-4b4e-ac22-b550fe4bb2fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:35.298001 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aeb50-e8cc-4b4e-ac22-b550fe4bb2fa service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:35.298694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aeb50-e8cc-4b4e-ac22-b550fe4bb2fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:35.299157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aeb50-e8cc-4b4e-ac22-b550fe4bb2fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:35.310964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aeb50-e8cc-4b4e-ac22-b550fe4bb2fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:35.316549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aeb50-e8cc-4b4e-ac22-b550fe4bb2fa service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:35.326223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 979/1944] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:22:40.452103 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a580158-1230-4ae9-ab6a-70141e0af23b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:40.452103 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a580158-1230-4ae9-ab6a-70141e0af23b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:40.452542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a580158-1230-4ae9-ab6a-70141e0af23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:40.479089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1a580158-1230-4ae9-ab6a-70141e0af23b None None] MFA Rules not processed for user `24211a806cfa4ee6b72c2e7b6074d473`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:40.480330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1a580158-1230-4ae9-ab6a-70141e0af23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:40.541023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 966/1945] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:40.998765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aeb50-e8cc-4b4e-ac22-b550fe4bb2fa service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:41.059505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:41.087030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aeb50-e8cc-4b4e-ac22-b550fe4bb2fa service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:41.094773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:41.095636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:41.096013 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:41.096384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] PATH_INFO: `/v3/users/5fa4b634e02d4042bade685e049a5b12` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:41.097671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa4b634e02d4042bade685e049a5b12)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:41.099930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:41.168786 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa4b634e02d4042bade685e049a5b12'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:41.169483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa4b634e02d4042bade685e049a5b12'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:41.178788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa4b634e02d4042bade685e049a5b12'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:41.188882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa4b634e02d4042bade685e049a5b12'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:41.189725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa4b634e02d4042bade685e049a5b12'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:41.216619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 980/1946] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:40 2022] DELETE /identity/v3/users/5fa4b634e02d4042bade685e049a5b12 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:41.218271 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935ecc-48a1-4606-853a-72d6133ccb16 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:41.218559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935ecc-48a1-4606-853a-72d6133ccb16 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:41.218837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff935ecc-48a1-4606-853a-72d6133ccb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:41.240298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ff935ecc-48a1-4606-853a-72d6133ccb16 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:41.241793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ff935ecc-48a1-4606-853a-72d6133ccb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:41.309456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 967/1947] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:41.320138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:41.321716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:41.392837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04048b-d924-4987-8823-8dffea9bbd65 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:41.396818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a19ad-8887-4c74-9759-84d11968f554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:41.397433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a19ad-8887-4c74-9759-84d11968f554 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:41.397717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a19ad-8887-4c74-9759-84d11968f554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:41.397991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a19ad-8887-4c74-9759-84d11968f554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:41.407834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a19ad-8887-4c74-9759-84d11968f554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:41.409282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a19ad-8887-4c74-9759-84d11968f554 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:41.419378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 981/1948] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:41.816357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff935ecc-48a1-4606-853a-72d6133ccb16 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:41.818095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ff935ecc-48a1-4606-853a-72d6133ccb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:41.837992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff935ecc-48a1-4606-853a-72d6133ccb16 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:41.845012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:41.845736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:41.846025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:41.846518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] PATH_INFO: `/v3/projects/864d7de405f645eb8ec013c1a00c1b45` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:41.848130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] RBAC: Authorizing `identity:delete_project(project_id=864d7de405f645eb8ec013c1a00c1b45)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:41.849956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:41.900832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864d7de405f645eb8ec013c1a00c1b45', 'request_id': 'req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:41.904875 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:41.917005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864d7de405f645eb8ec013c1a00c1b45', 'request_id': 'req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:41.926010 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864d7de405f645eb8ec013c1a00c1b45', 'request_id': 'req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:41.939720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] The token cache is being invalidate because project 864d7de405f645eb8ec013c1a00c1b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:41.940091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:41.940825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f61dbc62-ec2e-4bb9-87bc-35afee05d03c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:41.942471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 968/1949] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:41 2022] DELETE /identity/v3/projects/864d7de405f645eb8ec013c1a00c1b45 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:41.947349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ffc21-de17-4a36-8a46-6dc9bd27acd0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:41.947726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ffc21-de17-4a36-8a46-6dc9bd27acd0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:41.947986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ffc21-de17-4a36-8a46-6dc9bd27acd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:41.970459 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-bb8ffc21-de17-4a36-8a46-6dc9bd27acd0 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:41.972016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bb8ffc21-de17-4a36-8a46-6dc9bd27acd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:42.058217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 982/1950] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:42.066213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb601d-a9c8-45ca-a29a-4e6723ac71e3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.066581 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb601d-a9c8-45ca-a29a-4e6723ac71e3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.066918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb601d-a9c8-45ca-a29a-4e6723ac71e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.091300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-80bb601d-a9c8-45ca-a29a-4e6723ac71e3 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:42.094670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-80bb601d-a9c8-45ca-a29a-4e6723ac71e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:42.106534 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 969/1951] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:42.112396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ffc21-de17-4a36-8a46-6dc9bd27acd0 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:42.118497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:42.126456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ffc21-de17-4a36-8a46-6dc9bd27acd0 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:42.133541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0e37e-0fb7-44c2-ba6d-0e9c06172dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:42.134159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0e37e-0fb7-44c2-ba6d-0e9c06172dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.134666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0e37e-0fb7-44c2-ba6d-0e9c06172dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.135166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0e37e-0fb7-44c2-ba6d-0e9c06172dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.136290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0e37e-0fb7-44c2-ba6d-0e9c06172dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:42.136658 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0e37e-0fb7-44c2-ba6d-0e9c06172dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:42.138882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0e37e-0fb7-44c2-ba6d-0e9c06172dc1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:42.157469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 983/1952] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:22:42.159149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb601d-a9c8-45ca-a29a-4e6723ac71e3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:42.168450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb601d-a9c8-45ca-a29a-4e6723ac71e3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:42.173246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda86061-d8d5-4f04-9fca-fc13dc0ac156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:42.173855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda86061-d8d5-4f04-9fca-fc13dc0ac156 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.174130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda86061-d8d5-4f04-9fca-fc13dc0ac156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.174404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda86061-d8d5-4f04-9fca-fc13dc0ac156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.175043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda86061-d8d5-4f04-9fca-fc13dc0ac156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:42.176986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda86061-d8d5-4f04-9fca-fc13dc0ac156 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:42.209456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 970/1953] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:42 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:22:42.213636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0e37e-0fb7-44c2-ba6d-0e9c06172dc1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:42.230627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0e37e-0fb7-44c2-ba6d-0e9c06172dc1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:42.305131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a0722-4162-4618-b8bf-cefc876876b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:42.306136 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0722-4162-4618-b8bf-cefc876876b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.306635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0722-4162-4618-b8bf-cefc876876b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.307049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0722-4162-4618-b8bf-cefc876876b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.307848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a0722-4162-4618-b8bf-cefc876876b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:42.310012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a0722-4162-4618-b8bf-cefc876876b7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:42.344974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 984/1954] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:42 2022] POST /identity/v3/users => generated 281 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:42.349016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda86061-d8d5-4f04-9fca-fc13dc0ac156 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:42.360480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda86061-d8d5-4f04-9fca-fc13dc0ac156 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:42.368881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fbdbf-1832-4995-84ee-46380530c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:42.371304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fbdbf-1832-4995-84ee-46380530c5ac admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.371304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fbdbf-1832-4995-84ee-46380530c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.371304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fbdbf-1832-4995-84ee-46380530c5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.375811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fbdbf-1832-4995-84ee-46380530c5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:42.375811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fbdbf-1832-4995-84ee-46380530c5ac admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:42.393652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 971/1955] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:42.395620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a0722-4162-4618-b8bf-cefc876876b7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:42.406339 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a0722-4162-4618-b8bf-cefc876876b7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:42.411072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9dfdf-efa1-42e4-b54f-27dfcdbae448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:42.411877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9dfdf-efa1-42e4-b54f-27dfcdbae448 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.412010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9dfdf-efa1-42e4-b54f-27dfcdbae448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.412252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9dfdf-efa1-42e4-b54f-27dfcdbae448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.413049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9dfdf-efa1-42e4-b54f-27dfcdbae448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:42.414860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9dfdf-efa1-42e4-b54f-27dfcdbae448 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:42.426286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 985/1956] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:42.430311 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fbdbf-1832-4995-84ee-46380530c5ac admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:42.440907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fbdbf-1832-4995-84ee-46380530c5ac admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:42.446370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f03253-8783-464b-b53d-48cfb3a4d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:42.447220 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f03253-8783-464b-b53d-48cfb3a4d464 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.447552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f03253-8783-464b-b53d-48cfb3a4d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.447840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f03253-8783-464b-b53d-48cfb3a4d464 admin admin] PATH_INFO: `/v3/projects/95cf1429012f4953b76fd6b3a9703856/users/50c8662c76ba458594cf48d192df5c9c/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.463636 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f03253-8783-464b-b53d-48cfb3a4d464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cf1429012f4953b76fd6b3a9703856, user_id=50c8662c76ba458594cf48d192df5c9c, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:42.466316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f03253-8783-464b-b53d-48cfb3a4d464 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:42.479485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 972/1957] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:42 2022] PUT /identity/v3/projects/95cf1429012f4953b76fd6b3a9703856/users/50c8662c76ba458594cf48d192df5c9c/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:42.490925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535209e-50ac-4197-aad6-79a6bd4e98b3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.490925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535209e-50ac-4197-aad6-79a6bd4e98b3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.491141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535209e-50ac-4197-aad6-79a6bd4e98b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.525876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1535209e-50ac-4197-aad6-79a6bd4e98b3 None None] MFA Rules not processed for user `50c8662c76ba458594cf48d192df5c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:42.527095 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1535209e-50ac-4197-aad6-79a6bd4e98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:42.591846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 986/1958] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:42.628140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f03253-8783-464b-b53d-48cfb3a4d464 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:42.629840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c4f03253-8783-464b-b53d-48cfb3a4d464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:42.685540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f03253-8783-464b-b53d-48cfb3a4d464 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:42.689699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eed11-af76-4715-a401-90ff0bd27e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:42.690524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eed11-af76-4715-a401-90ff0bd27e24 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.690806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eed11-af76-4715-a401-90ff0bd27e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.691079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eed11-af76-4715-a401-90ff0bd27e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.699424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eed11-af76-4715-a401-90ff0bd27e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:42.701114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eed11-af76-4715-a401-90ff0bd27e24 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:42.710589 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 973/1959] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:42.726274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535209e-50ac-4197-aad6-79a6bd4e98b3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:42.812689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:42.820081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535209e-50ac-4197-aad6-79a6bd4e98b3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:42.826659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:42.827666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.828229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.828985 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] PATH_INFO: `/v3/users/50c8662c76ba458594cf48d192df5c9c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.830247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c8662c76ba458594cf48d192df5c9c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:42.832209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:42.888233 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c8662c76ba458594cf48d192df5c9c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:42.889126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c8662c76ba458594cf48d192df5c9c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:42.897746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c8662c76ba458594cf48d192df5c9c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:42.908596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c8662c76ba458594cf48d192df5c9c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:42.909330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c8662c76ba458594cf48d192df5c9c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:42.931049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 987/1960] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:42 2022] DELETE /identity/v3/users/50c8662c76ba458594cf48d192df5c9c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:42.936151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345feb-bdcf-47ca-b5f2-24f9436695c6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:42.936632 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345feb-bdcf-47ca-b5f2-24f9436695c6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:42.936711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345feb-bdcf-47ca-b5f2-24f9436695c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:42.960755 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e9345feb-bdcf-47ca-b5f2-24f9436695c6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:42.962013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e9345feb-bdcf-47ca-b5f2-24f9436695c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:43.076911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 974/1961] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:43.087807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:43.089331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:43.157861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee0cd7-ae38-4b03-b62e-2d62443c2c57 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:43.161650 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef03c2-be7d-4dec-a6bf-5513b9d3ada8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:43.162264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef03c2-be7d-4dec-a6bf-5513b9d3ada8 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:43.162545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef03c2-be7d-4dec-a6bf-5513b9d3ada8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:43.162825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef03c2-be7d-4dec-a6bf-5513b9d3ada8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:43.172353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef03c2-be7d-4dec-a6bf-5513b9d3ada8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:43.174805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef03c2-be7d-4dec-a6bf-5513b9d3ada8 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:43.186595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 988/1962] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:43.508342 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9345feb-bdcf-47ca-b5f2-24f9436695c6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:43.509838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e9345feb-bdcf-47ca-b5f2-24f9436695c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:43.536270 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9345feb-bdcf-47ca-b5f2-24f9436695c6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:43.547905 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:43.578551 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:43.578846 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:43.579127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] PATH_INFO: `/v3/projects/95cf1429012f4953b76fd6b3a9703856` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:43.582344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cf1429012f4953b76fd6b3a9703856)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:43.584310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:43.628785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:43.688909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cf1429012f4953b76fd6b3a9703856', 'request_id': 'req-2d54f93c-fc80-43ab-9fed-c32e185e21dd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:43.699790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cf1429012f4953b76fd6b3a9703856', 'request_id': 'req-2d54f93c-fc80-43ab-9fed-c32e185e21dd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:43.720232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cf1429012f4953b76fd6b3a9703856', 'request_id': 'req-2d54f93c-fc80-43ab-9fed-c32e185e21dd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:43.737182 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] The token cache is being invalidate because project 95cf1429012f4953b76fd6b3a9703856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:43.737510 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:43.738278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2d54f93c-fc80-43ab-9fed-c32e185e21dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:43.741569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 975/1963] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:43 2022] DELETE /identity/v3/projects/95cf1429012f4953b76fd6b3a9703856 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:43.746216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56036e-c1d3-4340-bd88-560a44724073 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:43.746506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56036e-c1d3-4340-bd88-560a44724073 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:43.746785 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56036e-c1d3-4340-bd88-560a44724073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:43.767560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ec56036e-c1d3-4340-bd88-560a44724073 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:43.768998 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ec56036e-c1d3-4340-bd88-560a44724073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:43.881140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 989/1964] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:43.888828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bb0e2-9218-47c0-ac9e-2eef9969e585 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:43.889126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bb0e2-9218-47c0-ac9e-2eef9969e585 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:43.890006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bb0e2-9218-47c0-ac9e-2eef9969e585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:43.934298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-aa5bb0e2-9218-47c0-ac9e-2eef9969e585 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:43.935579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-aa5bb0e2-9218-47c0-ac9e-2eef9969e585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:43.948179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 976/1965] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:43.949119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56036e-c1d3-4340-bd88-560a44724073 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:43.961908 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56036e-c1d3-4340-bd88-560a44724073 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:43.967201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dd1d1-4962-4a3d-a408-b9f8f008ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:43.967878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dd1d1-4962-4a3d-a408-b9f8f008ac49 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:43.968696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dd1d1-4962-4a3d-a408-b9f8f008ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:43.968979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dd1d1-4962-4a3d-a408-b9f8f008ac49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:43.969635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dd1d1-4962-4a3d-a408-b9f8f008ac49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:43.969937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dd1d1-4962-4a3d-a408-b9f8f008ac49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:43.971607 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dd1d1-4962-4a3d-a408-b9f8f008ac49 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:43.993188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 990/1966] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:22:43.994378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bb0e2-9218-47c0-ac9e-2eef9969e585 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:44.004951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bb0e2-9218-47c0-ac9e-2eef9969e585 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:44.010762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d851f-4138-4caa-af9e-946ebe6550e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:44.011366 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d851f-4138-4caa-af9e-946ebe6550e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:44.011692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d851f-4138-4caa-af9e-946ebe6550e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:44.011970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d851f-4138-4caa-af9e-946ebe6550e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:44.012767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d851f-4138-4caa-af9e-946ebe6550e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:44.021937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d851f-4138-4caa-af9e-946ebe6550e9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:44.061997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 977/1967] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:43 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:44.066386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dd1d1-4962-4a3d-a408-b9f8f008ac49 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:44.093915 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dd1d1-4962-4a3d-a408-b9f8f008ac49 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:44.099585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:44.190555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979edbb3-b7a2-4df6-a76e-111f9ca78c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:44.191299 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979edbb3-b7a2-4df6-a76e-111f9ca78c8a admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:44.191690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979edbb3-b7a2-4df6-a76e-111f9ca78c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:44.192063 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979edbb3-b7a2-4df6-a76e-111f9ca78c8a admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:44.192839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979edbb3-b7a2-4df6-a76e-111f9ca78c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:44.195077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979edbb3-b7a2-4df6-a76e-111f9ca78c8a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:44.222002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 991/1968] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:44 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:22:44.226280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d851f-4138-4caa-af9e-946ebe6550e9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:44.240156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d851f-4138-4caa-af9e-946ebe6550e9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:44.252409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c1ed-6740-4e69-8582-fdc133529564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:44.253667 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c1ed-6740-4e69-8582-fdc133529564 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:44.254074 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c1ed-6740-4e69-8582-fdc133529564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:44.254456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c1ed-6740-4e69-8582-fdc133529564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:44.255263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73c1ed-6740-4e69-8582-fdc133529564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:44.258115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73c1ed-6740-4e69-8582-fdc133529564 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:44.277963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 978/1969] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:22:44.283801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979edbb3-b7a2-4df6-a76e-111f9ca78c8a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:44.297646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979edbb3-b7a2-4df6-a76e-111f9ca78c8a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:44.304050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e227c-cbc9-490a-93fa-f02e82564156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:44.305664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e227c-cbc9-490a-93fa-f02e82564156 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:44.306668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e227c-cbc9-490a-93fa-f02e82564156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:44.307177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e227c-cbc9-490a-93fa-f02e82564156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:44.307977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e227c-cbc9-490a-93fa-f02e82564156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:44.311621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e227c-cbc9-490a-93fa-f02e82564156 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:44.328391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 992/1970] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:44.329039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c1ed-6740-4e69-8582-fdc133529564 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:44.339339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c1ed-6740-4e69-8582-fdc133529564 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:44.344843 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fa9e3-323a-491d-923c-8c9f34d7fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:44.345522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fa9e3-323a-491d-923c-8c9f34d7fd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:44.345958 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fa9e3-323a-491d-923c-8c9f34d7fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:44.346390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fa9e3-323a-491d-923c-8c9f34d7fd7a admin admin] PATH_INFO: `/v3/projects/9ebf73b3a46c49d3a1ef7a938e8ca0b7/users/31259ccafa8941f9b162da5a8ac5c752/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:44.370076 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fa9e3-323a-491d-923c-8c9f34d7fd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebf73b3a46c49d3a1ef7a938e8ca0b7, user_id=31259ccafa8941f9b162da5a8ac5c752, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:44.372959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fa9e3-323a-491d-923c-8c9f34d7fd7a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:44.388034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 979/1971] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:44 2022] PUT /identity/v3/projects/9ebf73b3a46c49d3a1ef7a938e8ca0b7/users/31259ccafa8941f9b162da5a8ac5c752/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:44.400497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e692e15-ed16-4c69-9ebf-be96c92d372e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:44.400797 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e692e15-ed16-4c69-9ebf-be96c92d372e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:44.401317 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e692e15-ed16-4c69-9ebf-be96c92d372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:44.434121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3e692e15-ed16-4c69-9ebf-be96c92d372e None None] MFA Rules not processed for user `31259ccafa8941f9b162da5a8ac5c752`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:44.435388 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3e692e15-ed16-4c69-9ebf-be96c92d372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:44.504862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 993/1972] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:44.516530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fa9e3-323a-491d-923c-8c9f34d7fd7a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:44.518317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-928fa9e3-323a-491d-923c-8c9f34d7fd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:44.577078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fa9e3-323a-491d-923c-8c9f34d7fd7a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:44.581252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed0869-9911-4460-b3ea-d50745d1caba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:44.581874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed0869-9911-4460-b3ea-d50745d1caba service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:44.582151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed0869-9911-4460-b3ea-d50745d1caba service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:44.582628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed0869-9911-4460-b3ea-d50745d1caba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:44.592488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed0869-9911-4460-b3ea-d50745d1caba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:44.594473 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed0869-9911-4460-b3ea-d50745d1caba service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:44.603786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 980/1973] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:49.595363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e692e15-ed16-4c69-9ebf-be96c92d372e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:49.597456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3e692e15-ed16-4c69-9ebf-be96c92d372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:49.732610 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e692e15-ed16-4c69-9ebf-be96c92d372e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:49.738629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:49.739888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:49.740433 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:49.740853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] PATH_INFO: `/v3/users/310f60db1a614850884bf455040bc809` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:49.742283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=310f60db1a614850884bf455040bc809)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:49.744810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:49.791638 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:49.837695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310f60db1a614850884bf455040bc809'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:49.838751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310f60db1a614850884bf455040bc809'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:49.850430 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310f60db1a614850884bf455040bc809'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:49.859910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310f60db1a614850884bf455040bc809'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:49.860588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310f60db1a614850884bf455040bc809'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:49.880240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 994/1974] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:49 2022] DELETE /identity/v3/users/310f60db1a614850884bf455040bc809 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:49.885140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f2515-9cbe-4e2d-8cb9-96e541eee413 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:49.885140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f2515-9cbe-4e2d-8cb9-96e541eee413 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:49.885771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f2515-9cbe-4e2d-8cb9-96e541eee413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:49.914011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-656f2515-9cbe-4e2d-8cb9-96e541eee413 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:49.915237 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-656f2515-9cbe-4e2d-8cb9-96e541eee413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:49.965913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:49.987692 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 981/1975] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:49.997797 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:49.999981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:50.060198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a47ec1-ac75-4357-a2ab-aa440b5ea997 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:50.064631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb7ab0-f621-490a-a5c6-3a23eb65a88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:50.065253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb7ab0-f621-490a-a5c6-3a23eb65a88a service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:50.065532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb7ab0-f621-490a-a5c6-3a23eb65a88a service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:50.065805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb7ab0-f621-490a-a5c6-3a23eb65a88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:50.075647 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb7ab0-f621-490a-a5c6-3a23eb65a88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:50.077008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb7ab0-f621-490a-a5c6-3a23eb65a88a service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:50.087552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 995/1976] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:50.376573 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f2515-9cbe-4e2d-8cb9-96e541eee413 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:50.378098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-656f2515-9cbe-4e2d-8cb9-96e541eee413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:50.394657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f2515-9cbe-4e2d-8cb9-96e541eee413 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:50.399464 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:50.400201 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:50.400494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:50.400773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] PATH_INFO: `/v3/projects/2cb07933242a401787271516f502f229` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:50.401901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb07933242a401787271516f502f229)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:50.405026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:50.458935 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb07933242a401787271516f502f229', 'request_id': 'req-77574a17-1c23-432b-aef4-a52323773c4f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:50.470419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb07933242a401787271516f502f229', 'request_id': 'req-77574a17-1c23-432b-aef4-a52323773c4f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:50.477779 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb07933242a401787271516f502f229', 'request_id': 'req-77574a17-1c23-432b-aef4-a52323773c4f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:50.490673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] The token cache is being invalidate because project 2cb07933242a401787271516f502f229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:50.490964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:50.491662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-77574a17-1c23-432b-aef4-a52323773c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:50.493162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 982/1977] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:50 2022] DELETE /identity/v3/projects/2cb07933242a401787271516f502f229 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:50.498096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0eec1-80be-44f6-885d-979375cc5599 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:50.498384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0eec1-80be-44f6-885d-979375cc5599 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:50.498659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0eec1-80be-44f6-885d-979375cc5599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:50.521012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-82d0eec1-80be-44f6-885d-979375cc5599 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:50.522228 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-82d0eec1-80be-44f6-885d-979375cc5599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:50.587590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 996/1978] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:50.597158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504e2e-5ec2-4b2b-850e-a8200a327727 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:50.597401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504e2e-5ec2-4b2b-850e-a8200a327727 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:50.597649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504e2e-5ec2-4b2b-850e-a8200a327727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:50.633652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6f504e2e-5ec2-4b2b-850e-a8200a327727 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:50.634913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6f504e2e-5ec2-4b2b-850e-a8200a327727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:50.645195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 983/1979] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:50.649384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0eec1-80be-44f6-885d-979375cc5599 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:50.660613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0eec1-80be-44f6-885d-979375cc5599 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:50.665789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f783-1caa-4350-b191-8c54653854ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:50.666453 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f783-1caa-4350-b191-8c54653854ae admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:50.666722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f783-1caa-4350-b191-8c54653854ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:50.666998 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f783-1caa-4350-b191-8c54653854ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:50.667704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202f783-1caa-4350-b191-8c54653854ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:50.668015 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202f783-1caa-4350-b191-8c54653854ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:50.669664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202f783-1caa-4350-b191-8c54653854ae admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:50.682974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 997/1980] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:22:50.688008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f504e2e-5ec2-4b2b-850e-a8200a327727 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:50.698003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f504e2e-5ec2-4b2b-850e-a8200a327727 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:50.705383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3602d-2d27-47a9-9cd7-03f683da3f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:50.706025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3602d-2d27-47a9-9cd7-03f683da3f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:50.706305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3602d-2d27-47a9-9cd7-03f683da3f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:50.706581 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3602d-2d27-47a9-9cd7-03f683da3f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:50.707232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3602d-2d27-47a9-9cd7-03f683da3f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:50.709327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3602d-2d27-47a9-9cd7-03f683da3f5d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:50.746035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 984/1981] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:50 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:50.750676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f783-1caa-4350-b191-8c54653854ae admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:50.761509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f783-1caa-4350-b191-8c54653854ae admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:50.784847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:50.828564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e8d6-7887-4531-ab9e-aba4f10d7ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:50.829181 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e8d6-7887-4531-ab9e-aba4f10d7ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:50.829462 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e8d6-7887-4531-ab9e-aba4f10d7ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:50.830258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e8d6-7887-4531-ab9e-aba4f10d7ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:50.830905 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e8d6-7887-4531-ab9e-aba4f10d7ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:50.832851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e8d6-7887-4531-ab9e-aba4f10d7ad2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:50.861718 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 998/1982] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:50 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:22:50.865923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3602d-2d27-47a9-9cd7-03f683da3f5d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:50.877896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3602d-2d27-47a9-9cd7-03f683da3f5d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:50.884048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150a7f8-acdf-4a9e-b205-646717bb526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:50.884765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150a7f8-acdf-4a9e-b205-646717bb526f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:50.885224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150a7f8-acdf-4a9e-b205-646717bb526f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:50.885945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150a7f8-acdf-4a9e-b205-646717bb526f admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:50.886388 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150a7f8-acdf-4a9e-b205-646717bb526f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:50.888117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150a7f8-acdf-4a9e-b205-646717bb526f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:50.900608 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 985/1983] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:50.904729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e8d6-7887-4531-ab9e-aba4f10d7ad2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:50.916265 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e8d6-7887-4531-ab9e-aba4f10d7ad2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:50.923456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e246d-3399-4477-a448-6422c12435f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:50.924316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e246d-3399-4477-a448-6422c12435f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:50.924644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e246d-3399-4477-a448-6422c12435f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:50.926340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e246d-3399-4477-a448-6422c12435f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:50.926340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e246d-3399-4477-a448-6422c12435f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:50.927148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e246d-3399-4477-a448-6422c12435f1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:50.940452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 999/1984] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:22:50.944474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150a7f8-acdf-4a9e-b205-646717bb526f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:50.955862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150a7f8-acdf-4a9e-b205-646717bb526f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:50.960798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d5680-038f-4e81-a6c2-a67f3213938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:50.961693 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d5680-038f-4e81-a6c2-a67f3213938b admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:50.962195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d5680-038f-4e81-a6c2-a67f3213938b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:50.962736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d5680-038f-4e81-a6c2-a67f3213938b admin admin] PATH_INFO: `/v3/projects/87a5d3ac4d714a1e8da408d03f976e87/users/725cd0a3733f41eb803d687dcda404f2/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:50.982005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d5680-038f-4e81-a6c2-a67f3213938b admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a5d3ac4d714a1e8da408d03f976e87, user_id=725cd0a3733f41eb803d687dcda404f2, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:50.985937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d5680-038f-4e81-a6c2-a67f3213938b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:51.017079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 986/1985] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:50 2022] PUT /identity/v3/projects/87a5d3ac4d714a1e8da408d03f976e87/users/725cd0a3733f41eb803d687dcda404f2/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:51.021829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213a67-c3a9-44c5-8eb3-faab02ef6722 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:51.022065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213a67-c3a9-44c5-8eb3-faab02ef6722 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:51.022344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213a67-c3a9-44c5-8eb3-faab02ef6722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:51.048710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6e213a67-c3a9-44c5-8eb3-faab02ef6722 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:51.050230 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6e213a67-c3a9-44c5-8eb3-faab02ef6722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:51.120864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1000/1986] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:51.131150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d5680-038f-4e81-a6c2-a67f3213938b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:51.132926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3b2d5680-038f-4e81-a6c2-a67f3213938b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:51.198116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d5680-038f-4e81-a6c2-a67f3213938b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:51.202938 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc059c3-b5ac-4548-93f4-c2fdbb5614c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:51.203602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc059c3-b5ac-4548-93f4-c2fdbb5614c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:51.203886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc059c3-b5ac-4548-93f4-c2fdbb5614c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:51.204152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc059c3-b5ac-4548-93f4-c2fdbb5614c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:51.214990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc059c3-b5ac-4548-93f4-c2fdbb5614c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:51.216680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc059c3-b5ac-4548-93f4-c2fdbb5614c4 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:51.226871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 987/1987] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:52.032337 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e213a67-c3a9-44c5-8eb3-faab02ef6722 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:52.033751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6e213a67-c3a9-44c5-8eb3-faab02ef6722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:52.046544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e213a67-c3a9-44c5-8eb3-faab02ef6722 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:52.054419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:52.055088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:52.055408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:52.055870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] PATH_INFO: `/v3/users/bc27e5c0a0044d1ca8e5f0bb1b61f5ba` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:52.057239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc27e5c0a0044d1ca8e5f0bb1b61f5ba)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:52.059416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:52.119756 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc27e5c0a0044d1ca8e5f0bb1b61f5ba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:52.120839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc27e5c0a0044d1ca8e5f0bb1b61f5ba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:52.129644 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc27e5c0a0044d1ca8e5f0bb1b61f5ba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:52.140357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc27e5c0a0044d1ca8e5f0bb1b61f5ba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:52.141529 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-30b3100c-6cce-4059-bee5-7b4bb4fcc026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc27e5c0a0044d1ca8e5f0bb1b61f5ba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:52.158512 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7d1f1-3479-49bf-a583-352e7618a286 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:52.160067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7d1f1-3479-49bf-a583-352e7618a286 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:52.160547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7d1f1-3479-49bf-a583-352e7618a286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:52.166082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1001/1988] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:52 2022] DELETE /identity/v3/users/bc27e5c0a0044d1ca8e5f0bb1b61f5ba => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:52.171680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320f11-952d-4a4a-94ca-2a8b16692925 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:52.173273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320f11-952d-4a4a-94ca-2a8b16692925 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:52.173760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320f11-952d-4a4a-94ca-2a8b16692925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:52.177986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:52.200599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c3b7d1f1-3479-49bf-a583-352e7618a286 None None] MFA Rules not processed for user `725cd0a3733f41eb803d687dcda404f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:52.202125 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7a320f11-952d-4a4a-94ca-2a8b16692925 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:52.202356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c3b7d1f1-3479-49bf-a583-352e7618a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:52.203617 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7a320f11-952d-4a4a-94ca-2a8b16692925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:52.217054 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:52.290018 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 988/1989] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:52.301152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7d1f1-3479-49bf-a583-352e7618a286 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:52.305118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c3b7d1f1-3479-49bf-a583-352e7618a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:52.315491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1002/1990] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:52.323180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320f11-952d-4a4a-94ca-2a8b16692925 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:52.324931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7a320f11-952d-4a4a-94ca-2a8b16692925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:52.384732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7d1f1-3479-49bf-a583-352e7618a286 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:52.389104 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08370e-0a71-42b9-a626-821f97067a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:52.389655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08370e-0a71-42b9-a626-821f97067a64 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:52.390061 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08370e-0a71-42b9-a626-821f97067a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:52.390269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08370e-0a71-42b9-a626-821f97067a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:52.399533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320f11-952d-4a4a-94ca-2a8b16692925 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:52.400006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08370e-0a71-42b9-a626-821f97067a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:52.401469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08370e-0a71-42b9-a626-821f97067a64 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:52.403728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf03ee-3852-47d7-9d30-6a85e3e6cea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:52.404166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf03ee-3852-47d7-9d30-6a85e3e6cea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:52.404477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf03ee-3852-47d7-9d30-6a85e3e6cea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:52.404969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf03ee-3852-47d7-9d30-6a85e3e6cea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:52.413117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 989/1991] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:52.415921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf03ee-3852-47d7-9d30-6a85e3e6cea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:52.417737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf03ee-3852-47d7-9d30-6a85e3e6cea4 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:52.429026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1003/1992] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:53.011029 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08370e-0a71-42b9-a626-821f97067a64 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:53.012741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ed08370e-0a71-42b9-a626-821f97067a64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:53.042553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08370e-0a71-42b9-a626-821f97067a64 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:53.050851 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:53.052232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.052664 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.053219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] PATH_INFO: `/v3/projects/d3e6703c04424a2286c53fdcb812d484` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.055122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e6703c04424a2286c53fdcb812d484)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:53.059458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:53.132315 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e6703c04424a2286c53fdcb812d484', 'request_id': 'req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:53.152030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e6703c04424a2286c53fdcb812d484', 'request_id': 'req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:53.161386 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e6703c04424a2286c53fdcb812d484', 'request_id': 'req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:53.183685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] The token cache is being invalidate because project d3e6703c04424a2286c53fdcb812d484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:53.183893 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:53.184675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-91ece55d-3079-4efd-8c3b-bca5dafb9a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:53.186261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 990/1993] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:53 2022] DELETE /identity/v3/projects/d3e6703c04424a2286c53fdcb812d484 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:53.191645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9187c-40c2-4e19-89b1-01caf2054938 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.192161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9187c-40c2-4e19-89b1-01caf2054938 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.192258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9187c-40c2-4e19-89b1-01caf2054938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.214484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8bd9187c-40c2-4e19-89b1-01caf2054938 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:53.216252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8bd9187c-40c2-4e19-89b1-01caf2054938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:53.300164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1004/1994] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:53.307993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcd8e9-a36a-40ff-9d9f-d4ac220019e6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.308347 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcd8e9-a36a-40ff-9d9f-d4ac220019e6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.308631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcd8e9-a36a-40ff-9d9f-d4ac220019e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.329995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-97bcd8e9-a36a-40ff-9d9f-d4ac220019e6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:53.331602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-97bcd8e9-a36a-40ff-9d9f-d4ac220019e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:53.339945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 991/1995] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:53.344404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9187c-40c2-4e19-89b1-01caf2054938 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:53.354487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9187c-40c2-4e19-89b1-01caf2054938 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:53.359723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b0b3-cbc2-44e7-b505-166e0e2f5310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:53.360321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b0b3-cbc2-44e7-b505-166e0e2f5310 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.360599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b0b3-cbc2-44e7-b505-166e0e2f5310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.360867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b0b3-cbc2-44e7-b505-166e0e2f5310 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.361886 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663b0b3-cbc2-44e7-b505-166e0e2f5310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:53.362229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663b0b3-cbc2-44e7-b505-166e0e2f5310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:53.364259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663b0b3-cbc2-44e7-b505-166e0e2f5310 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:53.378318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1005/1996] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:22:53.382814 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcd8e9-a36a-40ff-9d9f-d4ac220019e6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:53.392545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcd8e9-a36a-40ff-9d9f-d4ac220019e6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:53.397462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2efc75-a6e8-4076-a2b3-d9112bb881d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:53.398198 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2efc75-a6e8-4076-a2b3-d9112bb881d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.398753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2efc75-a6e8-4076-a2b3-d9112bb881d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.399241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2efc75-a6e8-4076-a2b3-d9112bb881d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.399918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2efc75-a6e8-4076-a2b3-d9112bb881d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:53.401814 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2efc75-a6e8-4076-a2b3-d9112bb881d6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:53.419920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:53.435215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 992/1997] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:53 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:53.439368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b0b3-cbc2-44e7-b505-166e0e2f5310 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:53.449735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b0b3-cbc2-44e7-b505-166e0e2f5310 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:53.498506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:53.512391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa290490-c6bd-4519-b946-065c0f7b5898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:53.513006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa290490-c6bd-4519-b946-065c0f7b5898 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.513283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa290490-c6bd-4519-b946-065c0f7b5898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.513604 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa290490-c6bd-4519-b946-065c0f7b5898 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.514233 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa290490-c6bd-4519-b946-065c0f7b5898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:53.516825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa290490-c6bd-4519-b946-065c0f7b5898 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:53.539263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1006/1998] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:53 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:22:53.543401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2efc75-a6e8-4076-a2b3-d9112bb881d6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:53.554198 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2efc75-a6e8-4076-a2b3-d9112bb881d6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:53.558821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b8df-f34a-4369-8ab2-1e21182f96a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:53.559453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b8df-f34a-4369-8ab2-1e21182f96a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.559737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b8df-f34a-4369-8ab2-1e21182f96a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.560022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b8df-f34a-4369-8ab2-1e21182f96a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.560655 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b8df-f34a-4369-8ab2-1e21182f96a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:53.562866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b8df-f34a-4369-8ab2-1e21182f96a2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:53.572734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 993/1999] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:53.576852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa290490-c6bd-4519-b946-065c0f7b5898 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:53.586723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa290490-c6bd-4519-b946-065c0f7b5898 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:53.591242 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce85f57-c78e-4b84-ab0d-f95689fd5616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:53.591865 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85f57-c78e-4b84-ab0d-f95689fd5616 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.592148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85f57-c78e-4b84-ab0d-f95689fd5616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.592425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85f57-c78e-4b84-ab0d-f95689fd5616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.593067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce85f57-c78e-4b84-ab0d-f95689fd5616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:53.594676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce85f57-c78e-4b84-ab0d-f95689fd5616 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:53.605081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1007/2000] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:53.609566 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b8df-f34a-4369-8ab2-1e21182f96a2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:53.619576 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b8df-f34a-4369-8ab2-1e21182f96a2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:53.624194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd359c3-549d-4132-9f77-ae496d188ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:53.624939 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd359c3-549d-4132-9f77-ae496d188ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.625274 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd359c3-549d-4132-9f77-ae496d188ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.625697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd359c3-549d-4132-9f77-ae496d188ebb admin admin] PATH_INFO: `/v3/projects/9152e69d2afd4c599732d73309991753/users/c3643e0a039c464a8c703ce9078523ba/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.641676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd359c3-549d-4132-9f77-ae496d188ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9152e69d2afd4c599732d73309991753, user_id=c3643e0a039c464a8c703ce9078523ba, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:53.644363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd359c3-549d-4132-9f77-ae496d188ebb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:53.657804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 994/2001] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:53 2022] PUT /identity/v3/projects/9152e69d2afd4c599732d73309991753/users/c3643e0a039c464a8c703ce9078523ba/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:53.669124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da987abc-4dd6-45ab-aa75-16aa74c2f91f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.669407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da987abc-4dd6-45ab-aa75-16aa74c2f91f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.669678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da987abc-4dd6-45ab-aa75-16aa74c2f91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.697426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-da987abc-4dd6-45ab-aa75-16aa74c2f91f None None] MFA Rules not processed for user `c3643e0a039c464a8c703ce9078523ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:53.698551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-da987abc-4dd6-45ab-aa75-16aa74c2f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:53.761450 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1008/2002] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:53.773361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd359c3-549d-4132-9f77-ae496d188ebb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:53.775023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-efd359c3-549d-4132-9f77-ae496d188ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:53.826771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90043a6a-3dd3-4862-82a2-b217c05c7087 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.827061 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90043a6a-3dd3-4862-82a2-b217c05c7087 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.828122 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90043a6a-3dd3-4862-82a2-b217c05c7087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.832841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd359c3-549d-4132-9f77-ae496d188ebb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:53.836797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712e371-6dfb-4b63-89da-f9695c7d993a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:53.837516 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712e371-6dfb-4b63-89da-f9695c7d993a service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.837793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712e371-6dfb-4b63-89da-f9695c7d993a service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.838298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712e371-6dfb-4b63-89da-f9695c7d993a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.848087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-90043a6a-3dd3-4862-82a2-b217c05c7087 None None] MFA Rules not processed for user `725cd0a3733f41eb803d687dcda404f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:53.848485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712e371-6dfb-4b63-89da-f9695c7d993a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:53.849291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-90043a6a-3dd3-4862-82a2-b217c05c7087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:53.849902 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712e371-6dfb-4b63-89da-f9695c7d993a service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:53.859099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 995/2003] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:53.884162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712e371-6dfb-4b63-89da-f9695c7d993a service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:53.907665 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1009/2004] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:53.956006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712e371-6dfb-4b63-89da-f9695c7d993a service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:53.961276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:53.962121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:53.962495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:53.962866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] PATH_INFO: `/v3/users/c3643e0a039c464a8c703ce9078523ba` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:53.964176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3643e0a039c464a8c703ce9078523ba)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:53.966231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:54.014307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3643e0a039c464a8c703ce9078523ba'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:54.022193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3643e0a039c464a8c703ce9078523ba'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:54.030160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3643e0a039c464a8c703ce9078523ba'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:54.031386 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:54.044457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3643e0a039c464a8c703ce9078523ba'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:54.045164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3643e0a039c464a8c703ce9078523ba'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:54.051703 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 996/2005] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:53 2022] DELETE /identity/v3/users/c3643e0a039c464a8c703ce9078523ba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:54.060800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f8f5-070f-46bd-8b33-62e383869783 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:54.061113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f8f5-070f-46bd-8b33-62e383869783 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:54.061393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f8f5-070f-46bd-8b33-62e383869783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:54.090773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ff71f8f5-070f-46bd-8b33-62e383869783 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:54.092100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ff71f8f5-070f-46bd-8b33-62e383869783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:54.147442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:54.158180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1010/2006] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:54.167852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:54.169396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:54.232696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b957-752b-4bb6-8617-4d4d6f36254d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:54.237111 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c00f71-8da2-407c-a581-c9448df658d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:54.237767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c00f71-8da2-407c-a581-c9448df658d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:54.238026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c00f71-8da2-407c-a581-c9448df658d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:54.238300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c00f71-8da2-407c-a581-c9448df658d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:54.250439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c00f71-8da2-407c-a581-c9448df658d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:54.252223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c00f71-8da2-407c-a581-c9448df658d2 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:54.278494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 997/2007] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:22:54.584067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f8f5-070f-46bd-8b33-62e383869783 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:54.585805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ff71f8f5-070f-46bd-8b33-62e383869783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:54.599375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f8f5-070f-46bd-8b33-62e383869783 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:54.604175 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:54.604929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:54.605516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:54.605893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] PATH_INFO: `/v3/projects/9152e69d2afd4c599732d73309991753` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:54.607148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9152e69d2afd4c599732d73309991753)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:54.609284 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:54.663961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9152e69d2afd4c599732d73309991753', 'request_id': 'req-b66d5be7-f913-4d51-a19c-2ce483d06e11'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:54.669999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9152e69d2afd4c599732d73309991753', 'request_id': 'req-b66d5be7-f913-4d51-a19c-2ce483d06e11'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:54.677338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9152e69d2afd4c599732d73309991753', 'request_id': 'req-b66d5be7-f913-4d51-a19c-2ce483d06e11'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:54.698211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] The token cache is being invalidate because project 9152e69d2afd4c599732d73309991753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:54.698511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:54.699166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b66d5be7-f913-4d51-a19c-2ce483d06e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:54.704201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1011/2008] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:54 2022] DELETE /identity/v3/projects/9152e69d2afd4c599732d73309991753 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:54.709292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d697a-ea13-4515-aa5f-e244443950c1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:54.709568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d697a-ea13-4515-aa5f-e244443950c1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:54.709847 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d697a-ea13-4515-aa5f-e244443950c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:54.734430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-682d697a-ea13-4515-aa5f-e244443950c1 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:54.735818 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-682d697a-ea13-4515-aa5f-e244443950c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:54.811209 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 998/2009] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:54.818817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16745ff-ca58-4f8a-8eef-aefefaeb6715 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:54.819102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16745ff-ca58-4f8a-8eef-aefefaeb6715 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:54.819419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16745ff-ca58-4f8a-8eef-aefefaeb6715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:54.844241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a16745ff-ca58-4f8a-8eef-aefefaeb6715 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:54.845552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a16745ff-ca58-4f8a-8eef-aefefaeb6715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:54.857595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1012/2010] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:54.862504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d697a-ea13-4515-aa5f-e244443950c1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:54.872537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d697a-ea13-4515-aa5f-e244443950c1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:54.877332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7796e-fe18-42ed-897c-95a025110fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:54.877937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7796e-fe18-42ed-897c-95a025110fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:54.878250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7796e-fe18-42ed-897c-95a025110fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:54.878470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7796e-fe18-42ed-897c-95a025110fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:54.879134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7796e-fe18-42ed-897c-95a025110fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:54.879442 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7796e-fe18-42ed-897c-95a025110fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:54.881020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7796e-fe18-42ed-897c-95a025110fb9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:54.897686 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 999/2011] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:22:54.900777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16745ff-ca58-4f8a-8eef-aefefaeb6715 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:54.913333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16745ff-ca58-4f8a-8eef-aefefaeb6715 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:54.918354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574548f-7394-4e17-b64f-ad5d2dc0cf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:54.919148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574548f-7394-4e17-b64f-ad5d2dc0cf55 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:54.919459 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574548f-7394-4e17-b64f-ad5d2dc0cf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:54.919737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574548f-7394-4e17-b64f-ad5d2dc0cf55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:54.920374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574548f-7394-4e17-b64f-ad5d2dc0cf55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:54.923032 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574548f-7394-4e17-b64f-ad5d2dc0cf55 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:54.962508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1013/2012] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:54 2022] POST /identity/v3/projects => generated 397 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:54.966462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7796e-fe18-42ed-897c-95a025110fb9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:54.979151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7796e-fe18-42ed-897c-95a025110fb9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:55.072656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517efcad-5259-4fc4-a8d4-a734ac42b665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:55.073430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517efcad-5259-4fc4-a8d4-a734ac42b665 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:55.073678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517efcad-5259-4fc4-a8d4-a734ac42b665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:55.074020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517efcad-5259-4fc4-a8d4-a734ac42b665 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:55.075605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517efcad-5259-4fc4-a8d4-a734ac42b665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:55.077662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517efcad-5259-4fc4-a8d4-a734ac42b665 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:55.103613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:55.113737 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1000/2013] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:54 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:55.116564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574548f-7394-4e17-b64f-ad5d2dc0cf55 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:55.137313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574548f-7394-4e17-b64f-ad5d2dc0cf55 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:55.150212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044724f-b3c1-49de-8956-2b9746764261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:55.150848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044724f-b3c1-49de-8956-2b9746764261 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:55.151131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044724f-b3c1-49de-8956-2b9746764261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:55.151465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044724f-b3c1-49de-8956-2b9746764261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:55.152128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044724f-b3c1-49de-8956-2b9746764261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:55.153717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044724f-b3c1-49de-8956-2b9746764261 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:55.168026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1014/2014] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:55.169238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517efcad-5259-4fc4-a8d4-a734ac42b665 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:55.180256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517efcad-5259-4fc4-a8d4-a734ac42b665 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:55.185316 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b76aef-b33c-4d33-b5bb-1c977a92ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:55.186065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b76aef-b33c-4d33-b5bb-1c977a92ef95 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:55.186389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b76aef-b33c-4d33-b5bb-1c977a92ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:55.187101 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b76aef-b33c-4d33-b5bb-1c977a92ef95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:55.187502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b76aef-b33c-4d33-b5bb-1c977a92ef95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:55.189542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b76aef-b33c-4d33-b5bb-1c977a92ef95 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:55.202178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1001/2015] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:55.206298 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044724f-b3c1-49de-8956-2b9746764261 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:55.225668 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044724f-b3c1-49de-8956-2b9746764261 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:55.237510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f0df7-9fc3-4e99-88af-1dc5c9111589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:55.241587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f0df7-9fc3-4e99-88af-1dc5c9111589 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:55.242527 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f0df7-9fc3-4e99-88af-1dc5c9111589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:55.242879 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f0df7-9fc3-4e99-88af-1dc5c9111589 admin admin] PATH_INFO: `/v3/projects/d001868f4a114c14874f6a9001b00409/users/44fdb09a52154324916c88448cffb4c2/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:55.263891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f0df7-9fc3-4e99-88af-1dc5c9111589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d001868f4a114c14874f6a9001b00409, user_id=44fdb09a52154324916c88448cffb4c2, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:55.267758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f0df7-9fc3-4e99-88af-1dc5c9111589 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:55.284382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1015/2016] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:55 2022] PUT /identity/v3/projects/d001868f4a114c14874f6a9001b00409/users/44fdb09a52154324916c88448cffb4c2/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:55.295037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098b6c-fe0c-4eb5-aa04-a0315a41d95f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:55.295438 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098b6c-fe0c-4eb5-aa04-a0315a41d95f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:55.295722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098b6c-fe0c-4eb5-aa04-a0315a41d95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:55.330949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ce098b6c-fe0c-4eb5-aa04-a0315a41d95f None None] MFA Rules not processed for user `44fdb09a52154324916c88448cffb4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:55.331501 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ce098b6c-fe0c-4eb5-aa04-a0315a41d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:55.350299 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f0df7-9fc3-4e99-88af-1dc5c9111589 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:55.352280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-696f0df7-9fc3-4e99-88af-1dc5c9111589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:55.420504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1002/2017] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:55.433886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce098b6c-fe0c-4eb5-aa04-a0315a41d95f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:55.435680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ce098b6c-fe0c-4eb5-aa04-a0315a41d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:55.451197 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f0df7-9fc3-4e99-88af-1dc5c9111589 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:55.457624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:55.458845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:55.458845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:55.459118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] PATH_INFO: `/v3/users/31259ccafa8941f9b162da5a8ac5c752` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:55.460869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31259ccafa8941f9b162da5a8ac5c752)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:55.463495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:55.497932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:55.516480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce098b6c-fe0c-4eb5-aa04-a0315a41d95f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:55.520363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d95075-7c65-4f83-97af-9d703cb1c263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:55.521000 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d95075-7c65-4f83-97af-9d703cb1c263 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:55.521278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d95075-7c65-4f83-97af-9d703cb1c263 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:55.521578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d95075-7c65-4f83-97af-9d703cb1c263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:55.533343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d95075-7c65-4f83-97af-9d703cb1c263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:55.534978 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d95075-7c65-4f83-97af-9d703cb1c263 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:55.537031 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31259ccafa8941f9b162da5a8ac5c752'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:55.537791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31259ccafa8941f9b162da5a8ac5c752'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:55.546817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31259ccafa8941f9b162da5a8ac5c752'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:55.547526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1003/2018] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:55.555781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31259ccafa8941f9b162da5a8ac5c752'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:55.556715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31259ccafa8941f9b162da5a8ac5c752'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:55.581559 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1016/2019] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:22:55 2022] DELETE /identity/v3/users/31259ccafa8941f9b162da5a8ac5c752 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:22:55.585624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e3dae-297d-4a64-bb6a-88a127968ed6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:55.586438 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e3dae-297d-4a64-bb6a-88a127968ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:55.586438 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e3dae-297d-4a64-bb6a-88a127968ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:55.606627 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a12e3dae-297d-4a64-bb6a-88a127968ed6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:55.607907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a12e3dae-297d-4a64-bb6a-88a127968ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:55.680430 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1004/2020] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:55.690387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:55.692502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:55.789428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443a9ca-9e7c-4082-8847-4e943e8ade60 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:55.791229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92835350-459a-4db4-a85e-5a74fdd75187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:55.791975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92835350-459a-4db4-a85e-5a74fdd75187 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:55.792354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92835350-459a-4db4-a85e-5a74fdd75187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:55.792727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92835350-459a-4db4-a85e-5a74fdd75187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:55.803087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92835350-459a-4db4-a85e-5a74fdd75187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:55.804695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92835350-459a-4db4-a85e-5a74fdd75187 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:55.816217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1017/2021] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:56.407305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e3dae-297d-4a64-bb6a-88a127968ed6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:56.408769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a12e3dae-297d-4a64-bb6a-88a127968ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:56.438219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e3dae-297d-4a64-bb6a-88a127968ed6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:56.445713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:56.446928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:56.447713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:56.447953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] PATH_INFO: `/v3/projects/9ebf73b3a46c49d3a1ef7a938e8ca0b7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:56.451660 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebf73b3a46c49d3a1ef7a938e8ca0b7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:56.472311 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:56.501952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:56.554555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebf73b3a46c49d3a1ef7a938e8ca0b7', 'request_id': 'req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:56.565598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebf73b3a46c49d3a1ef7a938e8ca0b7', 'request_id': 'req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:56.578656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebf73b3a46c49d3a1ef7a938e8ca0b7', 'request_id': 'req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:56.595842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] The token cache is being invalidate because project 9ebf73b3a46c49d3a1ef7a938e8ca0b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:22:56.596141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:56.597307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1045f12d-74d5-46fa-b416-c49c4ac5c4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:22:56.602125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1005/2022] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:22:56 2022] DELETE /identity/v3/projects/9ebf73b3a46c49d3a1ef7a938e8ca0b7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:56.606620 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab796ae-9f88-4055-89f9-a7288e49a9e7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:56.606941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab796ae-9f88-4055-89f9-a7288e49a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:56.607226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab796ae-9f88-4055-89f9-a7288e49a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:56.631065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-dab796ae-9f88-4055-89f9-a7288e49a9e7 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:56.632416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dab796ae-9f88-4055-89f9-a7288e49a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:56.714058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1018/2023] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:56.722600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c21a4-6c9e-4dda-a50b-8dcfa2d03ca2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:56.723034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c21a4-6c9e-4dda-a50b-8dcfa2d03ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:56.723342 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c21a4-6c9e-4dda-a50b-8dcfa2d03ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:56.744960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-275c21a4-6c9e-4dda-a50b-8dcfa2d03ca2 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:56.746301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-275c21a4-6c9e-4dda-a50b-8dcfa2d03ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:56.755109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1006/2024] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:56.759407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab796ae-9f88-4055-89f9-a7288e49a9e7 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:56.769717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab796ae-9f88-4055-89f9-a7288e49a9e7 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:56.782018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cad2a-8395-45b6-a7c0-1eb1af6c7447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:56.782656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cad2a-8395-45b6-a7c0-1eb1af6c7447 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:56.782934 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cad2a-8395-45b6-a7c0-1eb1af6c7447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:56.783229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cad2a-8395-45b6-a7c0-1eb1af6c7447 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:56.783920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cad2a-8395-45b6-a7c0-1eb1af6c7447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:22:56.784219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cad2a-8395-45b6-a7c0-1eb1af6c7447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:56.786025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cad2a-8395-45b6-a7c0-1eb1af6c7447 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:56.799984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1019/2025] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:22:56.803100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c21a4-6c9e-4dda-a50b-8dcfa2d03ca2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:56.814514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c21a4-6c9e-4dda-a50b-8dcfa2d03ca2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:56.820345 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068dcfc-fb49-4ec7-ab61-03364d5350a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:56.821132 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068dcfc-fb49-4ec7-ab61-03364d5350a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:56.821267 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068dcfc-fb49-4ec7-ab61-03364d5350a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:56.821493 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068dcfc-fb49-4ec7-ab61-03364d5350a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:56.822654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068dcfc-fb49-4ec7-ab61-03364d5350a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:56.824615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068dcfc-fb49-4ec7-ab61-03364d5350a9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:56.912183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1007/2026] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:22:56 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:56.916562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cad2a-8395-45b6-a7c0-1eb1af6c7447 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:56.930611 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cad2a-8395-45b6-a7c0-1eb1af6c7447 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:56.995397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:57.076046 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d5e73-492b-49bd-9205-9a50112d2c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:57.077629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5e73-492b-49bd-9205-9a50112d2c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:57.077963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5e73-492b-49bd-9205-9a50112d2c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:57.078242 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5e73-492b-49bd-9205-9a50112d2c93 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:57.078900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d5e73-492b-49bd-9205-9a50112d2c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:57.081315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d5e73-492b-49bd-9205-9a50112d2c93 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:57.109882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1020/2027] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:22:56 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:22:57.115555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068dcfc-fb49-4ec7-ab61-03364d5350a9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:57.147905 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068dcfc-fb49-4ec7-ab61-03364d5350a9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:57.159763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f55fce-d299-4b5c-a5c8-1fbd42ec4014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:57.160392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f55fce-d299-4b5c-a5c8-1fbd42ec4014 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:57.160815 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f55fce-d299-4b5c-a5c8-1fbd42ec4014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:57.161088 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f55fce-d299-4b5c-a5c8-1fbd42ec4014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:57.161733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f55fce-d299-4b5c-a5c8-1fbd42ec4014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:57.163466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f55fce-d299-4b5c-a5c8-1fbd42ec4014 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:57.193273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1008/2028] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:22:57.194040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d5e73-492b-49bd-9205-9a50112d2c93 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:57.209218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d5e73-492b-49bd-9205-9a50112d2c93 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:57.215102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b68d50-66d6-4412-ac87-a45cf3276cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:57.216068 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b68d50-66d6-4412-ac87-a45cf3276cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:57.216508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b68d50-66d6-4412-ac87-a45cf3276cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:57.216602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b68d50-66d6-4412-ac87-a45cf3276cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:57.217324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b68d50-66d6-4412-ac87-a45cf3276cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:57.220542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b68d50-66d6-4412-ac87-a45cf3276cf6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:57.235806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1021/2029] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:22:57.239480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f55fce-d299-4b5c-a5c8-1fbd42ec4014 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:57.257014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f55fce-d299-4b5c-a5c8-1fbd42ec4014 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:57.262562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9452a-a532-43bc-b92c-809ef8f0c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:57.263488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9452a-a532-43bc-b92c-809ef8f0c6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:57.263867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9452a-a532-43bc-b92c-809ef8f0c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:57.264232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9452a-a532-43bc-b92c-809ef8f0c6a2 admin admin] PATH_INFO: `/v3/projects/95949a8290a14149abdfebfdb98dcb2e/users/e56aa4551f214e8082dd8ab0808e6ed7/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:57.286873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9452a-a532-43bc-b92c-809ef8f0c6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95949a8290a14149abdfebfdb98dcb2e, user_id=e56aa4551f214e8082dd8ab0808e6ed7, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:57.290018 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9452a-a532-43bc-b92c-809ef8f0c6a2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:57.315311 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1009/2030] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:22:57 2022] PUT /identity/v3/projects/95949a8290a14149abdfebfdb98dcb2e/users/e56aa4551f214e8082dd8ab0808e6ed7/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:22:57.321254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646f444-1f6c-4608-b563-3e6279e3b3c8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:57.321932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646f444-1f6c-4608-b563-3e6279e3b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:57.322418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646f444-1f6c-4608-b563-3e6279e3b3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:57.347409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5646f444-1f6c-4608-b563-3e6279e3b3c8 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:57.350575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5646f444-1f6c-4608-b563-3e6279e3b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:57.486281 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1022/2031] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:22:57.503991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9452a-a532-43bc-b92c-809ef8f0c6a2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:57.510785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-76d9452a-a532-43bc-b92c-809ef8f0c6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:57.650988 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9452a-a532-43bc-b92c-809ef8f0c6a2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:57.656460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200afd7-d280-4084-bd79-06e5915a0d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:57.657871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200afd7-d280-4084-bd79-06e5915a0d3a service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:57.658549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200afd7-d280-4084-bd79-06e5915a0d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:57.659187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200afd7-d280-4084-bd79-06e5915a0d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:57.703924 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200afd7-d280-4084-bd79-06e5915a0d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:57.705517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200afd7-d280-4084-bd79-06e5915a0d3a service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:57.720309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c981b-8054-40d1-a2ca-6ddce0e85fd9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:57.721160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c981b-8054-40d1-a2ca-6ddce0e85fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:57.721513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c981b-8054-40d1-a2ca-6ddce0e85fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:57.741356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1010/2032] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:22:57.755940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-212c981b-8054-40d1-a2ca-6ddce0e85fd9 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:57.757603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-212c981b-8054-40d1-a2ca-6ddce0e85fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:57.870780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1023/2033] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:57.942842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200afd7-d280-4084-bd79-06e5915a0d3a service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:57.944489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2200afd7-d280-4084-bd79-06e5915a0d3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:58.007452 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:22:58.076798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200afd7-d280-4084-bd79-06e5915a0d3a service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:58.092454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51fb20-2e25-4333-b391-b5905ee7a64a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:58.093299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51fb20-2e25-4333-b391-b5905ee7a64a service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:58.093761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51fb20-2e25-4333-b391-b5905ee7a64a service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:58.094266 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51fb20-2e25-4333-b391-b5905ee7a64a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:58.120594 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51fb20-2e25-4333-b391-b5905ee7a64a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:58.122488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51fb20-2e25-4333-b391-b5905ee7a64a service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:58.137284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1011/2034] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:22:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:22:58.899460 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162d155-1f47-4826-9159-d7b87e12bba1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:58.899951 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162d155-1f47-4826-9159-d7b87e12bba1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:58.900173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162d155-1f47-4826-9159-d7b87e12bba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:58.927866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1162d155-1f47-4826-9159-d7b87e12bba1 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:58.930319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1162d155-1f47-4826-9159-d7b87e12bba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:58.956772 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1024/2035] 10.222.0.23 () {58 vars in 967 bytes} [Fri Oct 21 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:58.974868 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51fb20-2e25-4333-b391-b5905ee7a64a service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:58.993127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51fb20-2e25-4333-b391-b5905ee7a64a service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:58.999020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea815a34-3353-40c2-8dc7-d836d3d1481a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:59.000088 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea815a34-3353-40c2-8dc7-d836d3d1481a service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:59.000441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea815a34-3353-40c2-8dc7-d836d3d1481a service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:59.000803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea815a34-3353-40c2-8dc7-d836d3d1481a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:59.012706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea815a34-3353-40c2-8dc7-d836d3d1481a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:59.014953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea815a34-3353-40c2-8dc7-d836d3d1481a service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:59.031470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1012/2036] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:22:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:22:59.403466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22b7a6-38ef-4ca1-a7dd-5ddb06f5600a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:59.404655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22b7a6-38ef-4ca1-a7dd-5ddb06f5600a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:59.404944 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22b7a6-38ef-4ca1-a7dd-5ddb06f5600a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:59.432902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0b22b7a6-38ef-4ca1-a7dd-5ddb06f5600a None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:22:59.434743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0b22b7a6-38ef-4ca1-a7dd-5ddb06f5600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:22:59.445980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1025/2037] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:22:59.459687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea815a34-3353-40c2-8dc7-d836d3d1481a service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:22:59.471723 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea815a34-3353-40c2-8dc7-d836d3d1481a service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:22:59.478251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055c3e4-85e7-4f1e-b44d-1b6c1c389fb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:22:59.478408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055c3e4-85e7-4f1e-b44d-1b6c1c389fb7 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:22:59.478940 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055c3e4-85e7-4f1e-b44d-1b6c1c389fb7 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:22:59.479315 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055c3e4-85e7-4f1e-b44d-1b6c1c389fb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:22:59.489423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055c3e4-85e7-4f1e-b44d-1b6c1c389fb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:22:59.491975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055c3e4-85e7-4f1e-b44d-1b6c1c389fb7 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:22:59.504069 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1013/2038] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:22:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:23:00.096747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0cea1-1368-430d-be30-284b40a3b1a7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:00.096747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0cea1-1368-430d-be30-284b40a3b1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:00.097273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0cea1-1368-430d-be30-284b40a3b1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:00.128154 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d9f0cea1-1368-430d-be30-284b40a3b1a7 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:00.129721 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d9f0cea1-1368-430d-be30-284b40a3b1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:00.138757 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1026/2039] 10.222.0.23 () {58 vars in 967 bytes} [Fri Oct 21 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:00.174951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055c3e4-85e7-4f1e-b44d-1b6c1c389fb7 service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:00.195046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055c3e4-85e7-4f1e-b44d-1b6c1c389fb7 service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:00.207011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6250f4-16c4-4ad3-a9ed-acdaeb03ddad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:00.207683 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6250f4-16c4-4ad3-a9ed-acdaeb03ddad service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:00.207965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6250f4-16c4-4ad3-a9ed-acdaeb03ddad service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:00.208244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6250f4-16c4-4ad3-a9ed-acdaeb03ddad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:00.217676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6250f4-16c4-4ad3-a9ed-acdaeb03ddad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:00.219566 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6250f4-16c4-4ad3-a9ed-acdaeb03ddad service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:00.230126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1014/2040] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:23:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:23:01.145850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0cea1-1368-430d-be30-284b40a3b1a7 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:01.147147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d9f0cea1-1368-430d-be30-284b40a3b1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:01.177538 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0cea1-1368-430d-be30-284b40a3b1a7 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:01.206174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:01.206826 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:01.207108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:01.207411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] PATH_INFO: `/v3/users/44fdb09a52154324916c88448cffb4c2` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:01.214631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fdb09a52154324916c88448cffb4c2)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:01.224366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:01.327861 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:01.359428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fdb09a52154324916c88448cffb4c2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:01.362941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fdb09a52154324916c88448cffb4c2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:01.376804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fdb09a52154324916c88448cffb4c2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:01.392593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fdb09a52154324916c88448cffb4c2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:01.393629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fdb09a52154324916c88448cffb4c2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:01.428795 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1027/2041] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:23:01 2022] DELETE /identity/v3/users/44fdb09a52154324916c88448cffb4c2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:23:01.433521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893a395-b624-4885-b7a4-c23fecfb75eb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:01.434013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893a395-b624-4885-b7a4-c23fecfb75eb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:01.434013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893a395-b624-4885-b7a4-c23fecfb75eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:01.470347 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0893a395-b624-4885-b7a4-c23fecfb75eb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:01.471626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0893a395-b624-4885-b7a4-c23fecfb75eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:01.540700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1015/2042] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:01.553233 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:01.554954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:01.629562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bf878-f997-45d1-97c7-34b3ba5f7689 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:01.634704 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a0930-93af-40bd-9605-9fb4a43e870c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:01.635546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a0930-93af-40bd-9605-9fb4a43e870c service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:01.636474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a0930-93af-40bd-9605-9fb4a43e870c service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:01.639251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a0930-93af-40bd-9605-9fb4a43e870c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:01.650968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a0930-93af-40bd-9605-9fb4a43e870c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:01.652696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a0930-93af-40bd-9605-9fb4a43e870c service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:01.668007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1028/2043] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:23:02.451068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893a395-b624-4885-b7a4-c23fecfb75eb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:02.453975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0893a395-b624-4885-b7a4-c23fecfb75eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:02.469187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893a395-b624-4885-b7a4-c23fecfb75eb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:02.474317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:02.475236 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:02.475621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:02.475997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] PATH_INFO: `/v3/projects/d001868f4a114c14874f6a9001b00409` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:02.477248 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d001868f4a114c14874f6a9001b00409)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:02.479229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:02.564680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd001868f4a114c14874f6a9001b00409', 'request_id': 'req-b949b8f9-8e16-402f-b2d8-72709eff3024'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:02.576540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd001868f4a114c14874f6a9001b00409', 'request_id': 'req-b949b8f9-8e16-402f-b2d8-72709eff3024'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:02.584611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd001868f4a114c14874f6a9001b00409', 'request_id': 'req-b949b8f9-8e16-402f-b2d8-72709eff3024'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:02.602200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] The token cache is being invalidate because project d001868f4a114c14874f6a9001b00409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:23:02.602767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:02.603982 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b949b8f9-8e16-402f-b2d8-72709eff3024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:02.610169 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1016/2044] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:23:02 2022] DELETE /identity/v3/projects/d001868f4a114c14874f6a9001b00409 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:23:02.610835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faef0c-4616-427f-ab48-4f720921ebeb None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:02.611308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faef0c-4616-427f-ab48-4f720921ebeb None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:02.611431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faef0c-4616-427f-ab48-4f720921ebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:02.634411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-07faef0c-4616-427f-ab48-4f720921ebeb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:02.635866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-07faef0c-4616-427f-ab48-4f720921ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:02.761185 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346cc3b-eacb-4dc3-897a-9f7c6c221bb3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:02.761471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346cc3b-eacb-4dc3-897a-9f7c6c221bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:02.761749 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346cc3b-eacb-4dc3-897a-9f7c6c221bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:02.769415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1029/2045] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:23:02.788503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0346cc3b-eacb-4dc3-897a-9f7c6c221bb3 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:02.789764 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0346cc3b-eacb-4dc3-897a-9f7c6c221bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:02.798377 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1017/2046] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:02.802690 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faef0c-4616-427f-ab48-4f720921ebeb None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:02.815200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faef0c-4616-427f-ab48-4f720921ebeb None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:02.820353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824227f-737d-4c54-9563-fec2bcaf503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:02.820975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824227f-737d-4c54-9563-fec2bcaf503b admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:02.821255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824227f-737d-4c54-9563-fec2bcaf503b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:02.821531 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824227f-737d-4c54-9563-fec2bcaf503b admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:02.822321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824227f-737d-4c54-9563-fec2bcaf503b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:23:02.822624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824227f-737d-4c54-9563-fec2bcaf503b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:02.824438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824227f-737d-4c54-9563-fec2bcaf503b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:02.844752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346cc3b-eacb-4dc3-897a-9f7c6c221bb3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:02.865456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1030/2047] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:23:02.869176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346cc3b-eacb-4dc3-897a-9f7c6c221bb3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:02.884631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f6b98-8d0f-45c7-9ca6-7ebe468f1faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:02.885283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6b98-8d0f-45c7-9ca6-7ebe468f1faf admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:02.885561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6b98-8d0f-45c7-9ca6-7ebe468f1faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:02.885830 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6b98-8d0f-45c7-9ca6-7ebe468f1faf admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:02.886483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f6b98-8d0f-45c7-9ca6-7ebe468f1faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:02.892490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f6b98-8d0f-45c7-9ca6-7ebe468f1faf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:02.908065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:02.951098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1018/2048] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:23:02 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:23:02.954919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824227f-737d-4c54-9563-fec2bcaf503b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:02.973422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824227f-737d-4c54-9563-fec2bcaf503b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:03.044820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:03.089291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bc5a3-4013-4d53-9b43-b0ea54bf4c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:03.090642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc5a3-4013-4d53-9b43-b0ea54bf4c4d admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:03.091098 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc5a3-4013-4d53-9b43-b0ea54bf4c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:03.091570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc5a3-4013-4d53-9b43-b0ea54bf4c4d admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:03.094911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bc5a3-4013-4d53-9b43-b0ea54bf4c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:03.100393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bc5a3-4013-4d53-9b43-b0ea54bf4c4d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:03.160179 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1031/2049] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:23:02 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:23:03.161646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f6b98-8d0f-45c7-9ca6-7ebe468f1faf admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:03.182209 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f6b98-8d0f-45c7-9ca6-7ebe468f1faf admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:03.194870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bc5a3-4013-4d53-9b43-b0ea54bf4c4d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:03.197347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bb2bc5a3-4013-4d53-9b43-b0ea54bf4c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:03.204179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b701912-cf58-4023-a474-e7e9ccc5945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:03.204907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b701912-cf58-4023-a474-e7e9ccc5945e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:03.205750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b701912-cf58-4023-a474-e7e9ccc5945e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:03.206445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b701912-cf58-4023-a474-e7e9ccc5945e admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:03.209383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b701912-cf58-4023-a474-e7e9ccc5945e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:03.213733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b701912-cf58-4023-a474-e7e9ccc5945e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:03.217161 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bc5a3-4013-4d53-9b43-b0ea54bf4c4d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:03.230261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:03.231447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:03.231955 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:03.232401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] PATH_INFO: `/v3/users/0666947b1fb74faaba1b136abd0f426b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:03.236374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0666947b1fb74faaba1b136abd0f426b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:03.239392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:03.242707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1019/2050] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:23:03.252941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b701912-cf58-4023-a474-e7e9ccc5945e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:03.266963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b701912-cf58-4023-a474-e7e9ccc5945e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:03.273620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3040e5-2e42-4904-86ed-2c4983bbafb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:03.274123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3040e5-2e42-4904-86ed-2c4983bbafb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:03.274404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3040e5-2e42-4904-86ed-2c4983bbafb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:03.274676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3040e5-2e42-4904-86ed-2c4983bbafb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:03.275369 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3040e5-2e42-4904-86ed-2c4983bbafb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:03.277281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3040e5-2e42-4904-86ed-2c4983bbafb9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:03.297048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1020/2051] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:23:03.298084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3040e5-2e42-4904-86ed-2c4983bbafb9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:03.313373 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3040e5-2e42-4904-86ed-2c4983bbafb9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:03.322503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42746c-34ee-4fe5-9e6a-547bad4e72e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:03.323724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42746c-34ee-4fe5-9e6a-547bad4e72e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:03.324065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42746c-34ee-4fe5-9e6a-547bad4e72e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:03.324727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42746c-34ee-4fe5-9e6a-547bad4e72e2 admin admin] PATH_INFO: `/v3/projects/e8cf5b131752420e8df94874b78ae8f3/users/9a0dff4e7b34477b89c4e429a8c49280/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:03.353469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42746c-34ee-4fe5-9e6a-547bad4e72e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cf5b131752420e8df94874b78ae8f3, user_id=9a0dff4e7b34477b89c4e429a8c49280, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:03.359828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42746c-34ee-4fe5-9e6a-547bad4e72e2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:03.360058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0666947b1fb74faaba1b136abd0f426b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:03.361943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0666947b1fb74faaba1b136abd0f426b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:03.378974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0666947b1fb74faaba1b136abd0f426b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:03.387487 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1021/2052] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:23:03 2022] PUT /identity/v3/projects/e8cf5b131752420e8df94874b78ae8f3/users/9a0dff4e7b34477b89c4e429a8c49280/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:23:03.392158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f56e48-6a03-432f-a6c8-76d4a7cc4471 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:03.392498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f56e48-6a03-432f-a6c8-76d4a7cc4471 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:03.392778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f56e48-6a03-432f-a6c8-76d4a7cc4471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:03.398630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0666947b1fb74faaba1b136abd0f426b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:03.400214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9d0288dc-c80b-4030-836b-e206deba9393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0666947b1fb74faaba1b136abd0f426b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:03.423585 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-47f56e48-6a03-432f-a6c8-76d4a7cc4471 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:03.426555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1032/2053] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:23:03 2022] DELETE /identity/v3/users/0666947b1fb74faaba1b136abd0f426b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:23:03.426677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-47f56e48-6a03-432f-a6c8-76d4a7cc4471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:03.428792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e03ddb-c9a7-4593-b076-949d5462fd27 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:03.429083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e03ddb-c9a7-4593-b076-949d5462fd27 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:03.429542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e03ddb-c9a7-4593-b076-949d5462fd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:03.456407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-86e03ddb-c9a7-4593-b076-949d5462fd27 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:03.458127 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-86e03ddb-c9a7-4593-b076-949d5462fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:03.522629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1022/2054] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:03.551458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f56e48-6a03-432f-a6c8-76d4a7cc4471 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:03.554225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-47f56e48-6a03-432f-a6c8-76d4a7cc4471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:03.578806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1033/2055] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:23:03.600002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e03ddb-c9a7-4593-b076-949d5462fd27 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:03.601793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-86e03ddb-c9a7-4593-b076-949d5462fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:03.672059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:03.695538 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f56e48-6a03-432f-a6c8-76d4a7cc4471 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:03.699758 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9b2e2-f76b-4c58-92b7-d98a7d85ceab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:03.700657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9b2e2-f76b-4c58-92b7-d98a7d85ceab service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:03.700936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9b2e2-f76b-4c58-92b7-d98a7d85ceab service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:03.701206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9b2e2-f76b-4c58-92b7-d98a7d85ceab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:03.701321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e03ddb-c9a7-4593-b076-949d5462fd27 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:03.706063 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3de632-28ba-41bf-b792-f3cd5f638f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:03.706750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3de632-28ba-41bf-b792-f3cd5f638f19 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:03.706962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3de632-28ba-41bf-b792-f3cd5f638f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:03.707311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3de632-28ba-41bf-b792-f3cd5f638f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:03.720242 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3de632-28ba-41bf-b792-f3cd5f638f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:03.721751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3de632-28ba-41bf-b792-f3cd5f638f19 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:03.724193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9b2e2-f76b-4c58-92b7-d98a7d85ceab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:03.726254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9b2e2-f76b-4c58-92b7-d98a7d85ceab service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:03.740344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1034/2056] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:23:03.740867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1023/2057] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:23:04.508021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3de632-28ba-41bf-b792-f3cd5f638f19 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:04.509186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ce3de632-28ba-41bf-b792-f3cd5f638f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:04.528625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3de632-28ba-41bf-b792-f3cd5f638f19 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:04.549008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:04.550737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:04.552344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:04.554650 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] PATH_INFO: `/v3/projects/29ec8e0fc7bc4b04821d9b29ed5fadcf` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:04.556201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ec8e0fc7bc4b04821d9b29ed5fadcf)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:04.559019 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:04.666843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ec8e0fc7bc4b04821d9b29ed5fadcf', 'request_id': 'req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:04.673428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ec8e0fc7bc4b04821d9b29ed5fadcf', 'request_id': 'req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:04.680019 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ec8e0fc7bc4b04821d9b29ed5fadcf', 'request_id': 'req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:04.697252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] The token cache is being invalidate because project 29ec8e0fc7bc4b04821d9b29ed5fadcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:23:04.697684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:04.698684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:23:04.701196 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1035/2058] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:23:04 2022] DELETE /identity/v3/projects/29ec8e0fc7bc4b04821d9b29ed5fadcf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:23:05.338821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b0b49-9205-4e1a-9870-f5d324cae2c4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:05.340122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b0b49-9205-4e1a-9870-f5d324cae2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:05.340604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b0b49-9205-4e1a-9870-f5d324cae2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:05.376944 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d82b0b49-9205-4e1a-9870-f5d324cae2c4 None None] MFA Rules not processed for user `e56aa4551f214e8082dd8ab0808e6ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:05.391604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d82b0b49-9205-4e1a-9870-f5d324cae2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:05.450200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:05.507207 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1024/2059] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:05.511431 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:05.513449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:05.639977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dbb66-d8a2-4443-8fcb-46bb79dd47c7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:05.646483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d77915-944d-4f34-9d63-a0a4abfc7de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:05.647458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d77915-944d-4f34-9d63-a0a4abfc7de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:05.648100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d77915-944d-4f34-9d63-a0a4abfc7de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:05.648879 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d77915-944d-4f34-9d63-a0a4abfc7de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:05.649907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d77915-944d-4f34-9d63-a0a4abfc7de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:05.652174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d77915-944d-4f34-9d63-a0a4abfc7de3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:05.698955 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1036/2060] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:23:05 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:23:05.699616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b0b49-9205-4e1a-9870-f5d324cae2c4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:05.717379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b0b49-9205-4e1a-9870-f5d324cae2c4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:05.826654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271bf9e-2ad1-4a2f-98e5-8050d90f4de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:05.827364 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271bf9e-2ad1-4a2f-98e5-8050d90f4de7 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:05.827839 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271bf9e-2ad1-4a2f-98e5-8050d90f4de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:05.828143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271bf9e-2ad1-4a2f-98e5-8050d90f4de7 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:05.828768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271bf9e-2ad1-4a2f-98e5-8050d90f4de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:05.830794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271bf9e-2ad1-4a2f-98e5-8050d90f4de7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:05.872226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1025/2061] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:23:05 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:23:05.876396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d77915-944d-4f34-9d63-a0a4abfc7de3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:05.890390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d77915-944d-4f34-9d63-a0a4abfc7de3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:05.895890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cac82-ab28-4676-a305-3b95f46ee258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:05.896946 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cac82-ab28-4676-a305-3b95f46ee258 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:05.897446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cac82-ab28-4676-a305-3b95f46ee258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:05.897936 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cac82-ab28-4676-a305-3b95f46ee258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:05.898834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cac82-ab28-4676-a305-3b95f46ee258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:05.900919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cac82-ab28-4676-a305-3b95f46ee258 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:05.914398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1037/2062] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:23:05.918171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271bf9e-2ad1-4a2f-98e5-8050d90f4de7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:05.930086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271bf9e-2ad1-4a2f-98e5-8050d90f4de7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:05.935707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09822ad-f37d-4760-867c-34833abc76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:05.937375 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09822ad-f37d-4760-867c-34833abc76c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:05.937926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09822ad-f37d-4760-867c-34833abc76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:05.938401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09822ad-f37d-4760-867c-34833abc76c0 admin admin] PATH_INFO: `/v3/projects/3cb632fc62654941898ec80665876520/users/2b3798715105436b8753998c258b136e/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:05.969510 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09822ad-f37d-4760-867c-34833abc76c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb632fc62654941898ec80665876520, user_id=2b3798715105436b8753998c258b136e, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:05.973166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09822ad-f37d-4760-867c-34833abc76c0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:05.988047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124c435-68ba-4cc4-8631-ad197b227aa3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:05.988899 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124c435-68ba-4cc4-8631-ad197b227aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:05.990098 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124c435-68ba-4cc4-8631-ad197b227aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:05.998189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1026/2063] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:23:05 2022] PUT /identity/v3/projects/3cb632fc62654941898ec80665876520/users/2b3798715105436b8753998c258b136e/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:23:05.999865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09822ad-f37d-4760-867c-34833abc76c0 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:06.022049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1124c435-68ba-4cc4-8631-ad197b227aa3 None None] MFA Rules not processed for user `84af08afd232473b8c1c83ac3f0dee3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:06.023846 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1124c435-68ba-4cc4-8631-ad197b227aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:06.095939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:06.133131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09822ad-f37d-4760-867c-34833abc76c0 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:06.138545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54682847-1b4a-4b96-ae6c-202228ae0c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:06.139162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54682847-1b4a-4b96-ae6c-202228ae0c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:06.140042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1038/2064] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:06.156411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54682847-1b4a-4b96-ae6c-202228ae0c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:06.157302 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54682847-1b4a-4b96-ae6c-202228ae0c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:06.159795 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54682847-1b4a-4b96-ae6c-202228ae0c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:06.162528 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54682847-1b4a-4b96-ae6c-202228ae0c42 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:06.180652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1027/2065] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:23:06.184342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124c435-68ba-4cc4-8631-ad197b227aa3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:06.199625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124c435-68ba-4cc4-8631-ad197b227aa3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:06.205230 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbc6ea-e51b-456c-9b4d-6bf589af0371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:06.205889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbc6ea-e51b-456c-9b4d-6bf589af0371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:06.206296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbc6ea-e51b-456c-9b4d-6bf589af0371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:06.206642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbc6ea-e51b-456c-9b4d-6bf589af0371 admin admin] PATH_INFO: `/v3/projects/3cb632fc62654941898ec80665876520/users/2b3798715105436b8753998c258b136e/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:06.209482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbc6ea-e51b-456c-9b4d-6bf589af0371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb632fc62654941898ec80665876520, user_id=2b3798715105436b8753998c258b136e, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:06.212224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbc6ea-e51b-456c-9b4d-6bf589af0371 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:06.229164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1039/2066] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:23:06 2022] PUT /identity/v3/projects/3cb632fc62654941898ec80665876520/users/2b3798715105436b8753998c258b136e/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:23:12.337878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67943495-06e3-41de-bd4f-3670700f1b4a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:12.338734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67943495-06e3-41de-bd4f-3670700f1b4a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:12.341046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67943495-06e3-41de-bd4f-3670700f1b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:12.404506 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-67943495-06e3-41de-bd4f-3670700f1b4a None None] MFA Rules not processed for user `9a0dff4e7b34477b89c4e429a8c49280`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:12.407363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-67943495-06e3-41de-bd4f-3670700f1b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:12.448591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:12.536741 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1028/2067] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:12.541024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbc6ea-e51b-456c-9b4d-6bf589af0371 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:12.543145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fcfbc6ea-e51b-456c-9b4d-6bf589af0371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:12.755223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbc6ea-e51b-456c-9b4d-6bf589af0371 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:12.761145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038eda5a-0898-4c2c-9e4c-52a4520865f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:12.761978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038eda5a-0898-4c2c-9e4c-52a4520865f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:12.762411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038eda5a-0898-4c2c-9e4c-52a4520865f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:12.762851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038eda5a-0898-4c2c-9e4c-52a4520865f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:12.763693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038eda5a-0898-4c2c-9e4c-52a4520865f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:12.766548 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038eda5a-0898-4c2c-9e4c-52a4520865f2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:12.820008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1040/2068] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:23:12 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:23:12.821976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67943495-06e3-41de-bd4f-3670700f1b4a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:12.835353 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67943495-06e3-41de-bd4f-3670700f1b4a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:13.020946 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c951d-9159-4154-835c-4f16d59e815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:13.021585 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c951d-9159-4154-835c-4f16d59e815d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:13.021863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c951d-9159-4154-835c-4f16d59e815d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:13.022141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c951d-9159-4154-835c-4f16d59e815d admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:13.022797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c951d-9159-4154-835c-4f16d59e815d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:13.024772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c951d-9159-4154-835c-4f16d59e815d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:13.061198 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1029/2069] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:23:12 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:23:13.064727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038eda5a-0898-4c2c-9e4c-52a4520865f2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:13.089516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038eda5a-0898-4c2c-9e4c-52a4520865f2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:13.106940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2f1f-c3f8-4756-8bee-7b27708a63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:13.109351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2f1f-c3f8-4756-8bee-7b27708a63db admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:13.110538 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2f1f-c3f8-4756-8bee-7b27708a63db admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:13.110828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2f1f-c3f8-4756-8bee-7b27708a63db admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:13.113220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec2f1f-c3f8-4756-8bee-7b27708a63db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:13.117623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec2f1f-c3f8-4756-8bee-7b27708a63db admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:13.139604 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1041/2070] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:23:13.143068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c951d-9159-4154-835c-4f16d59e815d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:13.161471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c951d-9159-4154-835c-4f16d59e815d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:13.168105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba74cd-39df-4b6a-982a-a2df8e5530a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:13.168795 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba74cd-39df-4b6a-982a-a2df8e5530a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:13.169079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba74cd-39df-4b6a-982a-a2df8e5530a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:13.169355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba74cd-39df-4b6a-982a-a2df8e5530a2 admin admin] PATH_INFO: `/v3/projects/5898a12cb4f44a80b6146b57cdad681d/users/bda6b31c8e9949d98348b9f404262f0c/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:13.201465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba74cd-39df-4b6a-982a-a2df8e5530a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5898a12cb4f44a80b6146b57cdad681d, user_id=bda6b31c8e9949d98348b9f404262f0c, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:13.208815 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba74cd-39df-4b6a-982a-a2df8e5530a2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:13.235822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2f1f-c3f8-4756-8bee-7b27708a63db admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:13.236098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1030/2071] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:23:13 2022] PUT /identity/v3/projects/5898a12cb4f44a80b6146b57cdad681d/users/bda6b31c8e9949d98348b9f404262f0c/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:23:13.253079 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2f1f-c3f8-4756-8bee-7b27708a63db admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:13.350326 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14507fe-9621-4152-9e0e-d4015724e2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:13.350965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14507fe-9621-4152-9e0e-d4015724e2fe admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:13.351247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14507fe-9621-4152-9e0e-d4015724e2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:13.351552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14507fe-9621-4152-9e0e-d4015724e2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:13.352613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14507fe-9621-4152-9e0e-d4015724e2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:13.353830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14507fe-9621-4152-9e0e-d4015724e2fe admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:13.368449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1042/2072] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:23:13.373491 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba74cd-39df-4b6a-982a-a2df8e5530a2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:13.388392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba74cd-39df-4b6a-982a-a2df8e5530a2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:13.393580 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd6419-0ff9-4d7e-a055-383728889594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:13.394254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd6419-0ff9-4d7e-a055-383728889594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:13.394796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd6419-0ff9-4d7e-a055-383728889594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:13.395094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd6419-0ff9-4d7e-a055-383728889594 admin admin] PATH_INFO: `/v3/projects/5898a12cb4f44a80b6146b57cdad681d/users/bda6b31c8e9949d98348b9f404262f0c/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:13.397808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd6419-0ff9-4d7e-a055-383728889594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5898a12cb4f44a80b6146b57cdad681d, user_id=bda6b31c8e9949d98348b9f404262f0c, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:13.399994 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd6419-0ff9-4d7e-a055-383728889594 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:13.452174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1031/2073] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:23:13 2022] PUT /identity/v3/projects/5898a12cb4f44a80b6146b57cdad681d/users/bda6b31c8e9949d98348b9f404262f0c/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:23:15.232395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafd695-661f-4e06-bc1a-0085cce65e4c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:15.233551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafd695-661f-4e06-bc1a-0085cce65e4c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:15.233551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafd695-661f-4e06-bc1a-0085cce65e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:15.264549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-faafd695-661f-4e06-bc1a-0085cce65e4c None None] MFA Rules not processed for user `2b3798715105436b8753998c258b136e`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:15.266060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-faafd695-661f-4e06-bc1a-0085cce65e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:15.300356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:15.365115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1043/2074] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:15.378586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd6419-0ff9-4d7e-a055-383728889594 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:15.381125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cfbd6419-0ff9-4d7e-a055-383728889594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:15.581415 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd6419-0ff9-4d7e-a055-383728889594 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:15.593659 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e6394-9c5e-478d-a42a-1c10968cd0dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec1b2a49264e4e9218b65f9ff114b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:15.600248 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e6394-9c5e-478d-a42a-1c10968cd0dd service glance] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:15.600721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e6394-9c5e-478d-a42a-1c10968cd0dd service glance] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:15.601156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e6394-9c5e-478d-a42a-1c10968cd0dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:15.690097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:15.723068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e6394-9c5e-478d-a42a-1c10968cd0dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:15.724912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e6394-9c5e-478d-a42a-1c10968cd0dd service glance] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:15.749799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1032/2075] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:23:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:23:15.983714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348a99-0687-470e-966a-881e19928608 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:15.985359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348a99-0687-470e-966a-881e19928608 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:15.986285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348a99-0687-470e-966a-881e19928608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:16.010148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-2f348a99-0687-470e-966a-881e19928608 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:16.011850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2f348a99-0687-470e-966a-881e19928608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:16.153587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1044/2076] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:16.170761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e6394-9c5e-478d-a42a-1c10968cd0dd service glance] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:16.175465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-111e6394-9c5e-478d-a42a-1c10968cd0dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:16.269665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e6394-9c5e-478d-a42a-1c10968cd0dd service glance] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:16.280211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567abcb-35a7-4fdd-8db3-b418cc3a306b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:16.280955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567abcb-35a7-4fdd-8db3-b418cc3a306b service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:16.281337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567abcb-35a7-4fdd-8db3-b418cc3a306b service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:16.281714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567abcb-35a7-4fdd-8db3-b418cc3a306b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:16.291358 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567abcb-35a7-4fdd-8db3-b418cc3a306b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:16.293107 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567abcb-35a7-4fdd-8db3-b418cc3a306b service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:16.315810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1033/2077] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:23:21.171721 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85612e69-58ec-4f9a-84b1-7086bad0ec47 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:21.172286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85612e69-58ec-4f9a-84b1-7086bad0ec47 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:21.172286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85612e69-58ec-4f9a-84b1-7086bad0ec47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:21.261562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-85612e69-58ec-4f9a-84b1-7086bad0ec47 None None] MFA Rules not processed for user `bda6b31c8e9949d98348b9f404262f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:21.263101 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-85612e69-58ec-4f9a-84b1-7086bad0ec47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:21.525131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1045/2078] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:21.533531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567abcb-35a7-4fdd-8db3-b418cc3a306b service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:21.535878 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2567abcb-35a7-4fdd-8db3-b418cc3a306b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:21.696314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567abcb-35a7-4fdd-8db3-b418cc3a306b service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:21.706925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cf3e2-99a9-42d8-8f32-ded6440a56a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:21.707160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cf3e2-99a9-42d8-8f32-ded6440a56a7 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:21.707928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cf3e2-99a9-42d8-8f32-ded6440a56a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:21.707928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cf3e2-99a9-42d8-8f32-ded6440a56a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:21.842431 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cf3e2-99a9-42d8-8f32-ded6440a56a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:21.845600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cf3e2-99a9-42d8-8f32-ded6440a56a7 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:21.855540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:21.864970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1034/2079] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:23:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:23:24.184020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac3cb8-d77c-4f2a-8255-7f18b09d9f8c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:24.185029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac3cb8-d77c-4f2a-8255-7f18b09d9f8c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:24.185333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac3cb8-d77c-4f2a-8255-7f18b09d9f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:24.214507 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4eac3cb8-d77c-4f2a-8255-7f18b09d9f8c None None] MFA Rules not processed for user `9a0dff4e7b34477b89c4e429a8c49280`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:24.215932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4eac3cb8-d77c-4f2a-8255-7f18b09d9f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:24.239676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1046/2080] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:32.579614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f15a86-3f6f-4bad-b53f-a16e639be849 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:32.580242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f15a86-3f6f-4bad-b53f-a16e639be849 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:32.580242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f15a86-3f6f-4bad-b53f-a16e639be849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:32.602827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-83f15a86-3f6f-4bad-b53f-a16e639be849 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:32.604081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-83f15a86-3f6f-4bad-b53f-a16e639be849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:32.607546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa3688-3f9c-4040-991c-b44370f7f3a8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:32.608052 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa3688-3f9c-4040-991c-b44370f7f3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:32.608154 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa3688-3f9c-4040-991c-b44370f7f3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:32.630203 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-59fa3688-3f9c-4040-991c-b44370f7f3a8 None None] MFA Rules not processed for user `e56aa4551f214e8082dd8ab0808e6ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:32.631465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-59fa3688-3f9c-4040-991c-b44370f7f3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:32.639134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1047/2081] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:23:32.669050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1035/2082] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:32.693098 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa3688-3f9c-4040-991c-b44370f7f3a8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:32.706860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa3688-3f9c-4040-991c-b44370f7f3a8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:32.712299 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02d440-9feb-4b5d-b4db-39d6c590853f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:32.712940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d440-9feb-4b5d-b4db-39d6c590853f service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:32.713218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d440-9feb-4b5d-b4db-39d6c590853f service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:32.713491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d440-9feb-4b5d-b4db-39d6c590853f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:32.722200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02d440-9feb-4b5d-b4db-39d6c590853f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:32.723845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02d440-9feb-4b5d-b4db-39d6c590853f service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:32.734245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1048/2083] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:23:35.633043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952969c1-c5a5-43e1-9b34-21dfa99611ce None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:35.633561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952969c1-c5a5-43e1-9b34-21dfa99611ce None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:35.633671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952969c1-c5a5-43e1-9b34-21dfa99611ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:35.654604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-952969c1-c5a5-43e1-9b34-21dfa99611ce None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:35.655841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-952969c1-c5a5-43e1-9b34-21dfa99611ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:35.667697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1036/2084] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:35.697522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02d440-9feb-4b5d-b4db-39d6c590853f service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:35.698965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3e02d440-9feb-4b5d-b4db-39d6c590853f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:35.714670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02d440-9feb-4b5d-b4db-39d6c590853f service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:35.720436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810235e-e079-4641-8e71-bf6dde13a054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:35.721141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810235e-e079-4641-8e71-bf6dde13a054 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:35.721494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810235e-e079-4641-8e71-bf6dde13a054 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:35.721774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810235e-e079-4641-8e71-bf6dde13a054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:35.736163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810235e-e079-4641-8e71-bf6dde13a054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:35.738023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810235e-e079-4641-8e71-bf6dde13a054 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:35.754512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1049/2085] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:23:37.281638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647672-22b2-4e98-9e18-189457c81adb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:37.282192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647672-22b2-4e98-9e18-189457c81adb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:37.282308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647672-22b2-4e98-9e18-189457c81adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:37.304250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-32647672-22b2-4e98-9e18-189457c81adb None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:37.305540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-32647672-22b2-4e98-9e18-189457c81adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:37.313459 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1037/2086] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:23:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:37.346514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810235e-e079-4641-8e71-bf6dde13a054 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:37.361237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810235e-e079-4641-8e71-bf6dde13a054 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:37.367359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55856-aff3-45c1-aa83-2469ce9e0105 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:37.368056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55856-aff3-45c1-aa83-2469ce9e0105 service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:37.368419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55856-aff3-45c1-aa83-2469ce9e0105 service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:37.368763 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55856-aff3-45c1-aa83-2469ce9e0105 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:37.377835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d55856-aff3-45c1-aa83-2469ce9e0105 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:37.379457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d55856-aff3-45c1-aa83-2469ce9e0105 service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:37.387726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1050/2087] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:23:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 21 21:23:47.297948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=33 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:47.384229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:23:52.258913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8d19-3db5-4b0e-810e-ea93255e03c4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:52.259522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8d19-3db5-4b0e-810e-ea93255e03c4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:52.259626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8d19-3db5-4b0e-810e-ea93255e03c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:52.279688 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8c4d8d19-3db5-4b0e-810e-ea93255e03c4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:52.281375 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8c4d8d19-3db5-4b0e-810e-ea93255e03c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:52.289137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1038/2088] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:52.310234 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55856-aff3-45c1-aa83-2469ce9e0105 service swift] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:52.322024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55856-aff3-45c1-aa83-2469ce9e0105 service swift] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:52.327734 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954fcf3-ad22-45ac-9270-45dd35ff0cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:52.328325 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954fcf3-ad22-45ac-9270-45dd35ff0cd9 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:52.328601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954fcf3-ad22-45ac-9270-45dd35ff0cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:52.328872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954fcf3-ad22-45ac-9270-45dd35ff0cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:52.336895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954fcf3-ad22-45ac-9270-45dd35ff0cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:52.338446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954fcf3-ad22-45ac-9270-45dd35ff0cd9 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:52.348416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1051/2089] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:23:57.433252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a6bec-927c-485b-8b39-d173fb9f6a9b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:57.434367 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a6bec-927c-485b-8b39-d173fb9f6a9b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:57.434669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a6bec-927c-485b-8b39-d173fb9f6a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:57.456625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b42a6bec-927c-485b-8b39-d173fb9f6a9b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:23:57.457925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b42a6bec-927c-485b-8b39-d173fb9f6a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:23:57.466058 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1039/2090] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:23:57.508055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954fcf3-ad22-45ac-9270-45dd35ff0cd9 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:23:57.523135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954fcf3-ad22-45ac-9270-45dd35ff0cd9 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:23:57.529494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f78d8-92f1-4b12-99ef-b56077ec05f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:23:57.530105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f78d8-92f1-4b12-99ef-b56077ec05f6 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:23:57.530578 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f78d8-92f1-4b12-99ef-b56077ec05f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:23:57.530863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f78d8-92f1-4b12-99ef-b56077ec05f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:23:57.539764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f78d8-92f1-4b12-99ef-b56077ec05f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:23:57.541485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f78d8-92f1-4b12-99ef-b56077ec05f6 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:23:57.551384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1052/2091] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:24:03.704289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af7cdf-fa4e-4929-8642-b347949fcffe None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:03.704779 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af7cdf-fa4e-4929-8642-b347949fcffe None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:03.704876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af7cdf-fa4e-4929-8642-b347949fcffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:03.725588 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-53af7cdf-fa4e-4929-8642-b347949fcffe None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:24:03.726796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-53af7cdf-fa4e-4929-8642-b347949fcffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:03.735232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1040/2092] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:24:03.761000 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f78d8-92f1-4b12-99ef-b56077ec05f6 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:24:03.774055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f78d8-92f1-4b12-99ef-b56077ec05f6 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:24:03.781100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb412c-06b4-4571-804b-ad32f3f3ded6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:24:03.781839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb412c-06b4-4571-804b-ad32f3f3ded6 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:03.782120 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb412c-06b4-4571-804b-ad32f3f3ded6 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:03.782391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb412c-06b4-4571-804b-ad32f3f3ded6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:03.790792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb412c-06b4-4571-804b-ad32f3f3ded6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:24:03.792439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb412c-06b4-4571-804b-ad32f3f3ded6 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:24:03.802292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1053/2093] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:24:06.930016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af7cdf-fa4e-4929-8642-b347949fcffe None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:24:06.931609 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-53af7cdf-fa4e-4929-8642-b347949fcffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:06.991458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af7cdf-fa4e-4929-8642-b347949fcffe None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:24:06.995012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a708c6-335d-41b2-948f-b9b75bdde78f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:24:06.995650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a708c6-335d-41b2-948f-b9b75bdde78f service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:06.995928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a708c6-335d-41b2-948f-b9b75bdde78f service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:06.996199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a708c6-335d-41b2-948f-b9b75bdde78f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:07.005242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a708c6-335d-41b2-948f-b9b75bdde78f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:24:07.006657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a708c6-335d-41b2-948f-b9b75bdde78f service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:24:07.016469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1041/2094] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:24:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:24:08.939280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee4f37-e9b4-475f-8989-35e904c49d45 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:08.940804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee4f37-e9b4-475f-8989-35e904c49d45 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:08.941302 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee4f37-e9b4-475f-8989-35e904c49d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:08.965495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f2ee4f37-e9b4-475f-8989-35e904c49d45 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:24:08.966983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f2ee4f37-e9b4-475f-8989-35e904c49d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:08.975137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1054/2095] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:24:09.000104 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a708c6-335d-41b2-948f-b9b75bdde78f service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:24:09.013152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a708c6-335d-41b2-948f-b9b75bdde78f service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:24:09.018734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76f13-5092-4579-b0ac-f87ec14d98ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:24:09.019573 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76f13-5092-4579-b0ac-f87ec14d98ff service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:09.019855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76f13-5092-4579-b0ac-f87ec14d98ff service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:09.020125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76f13-5092-4579-b0ac-f87ec14d98ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:09.028349 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76f13-5092-4579-b0ac-f87ec14d98ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:24:09.029922 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76f13-5092-4579-b0ac-f87ec14d98ff service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:24:09.039856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1042/2096] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:24:12.067366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee4f37-e9b4-475f-8989-35e904c49d45 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:24:12.077245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee4f37-e9b4-475f-8989-35e904c49d45 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:24:12.080794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b8abb-bed6-4d11-bd66-ee01717475d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:24:12.081383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8abb-bed6-4d11-bd66-ee01717475d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:12.081657 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8abb-bed6-4d11-bd66-ee01717475d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:12.081924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8abb-bed6-4d11-bd66-ee01717475d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:12.090598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b8abb-bed6-4d11-bd66-ee01717475d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:24:12.092202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b8abb-bed6-4d11-bd66-ee01717475d1 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:24:12.101381 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1055/2097] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:24:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:24:13.869170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76f13-5092-4579-b0ac-f87ec14d98ff service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:24:13.870555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dfa76f13-5092-4579-b0ac-f87ec14d98ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:13.946302 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76f13-5092-4579-b0ac-f87ec14d98ff service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:24:13.951746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820ecf5-7891-4605-a966-97f058f36d74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa89e84c708f44c299c728284e33fabf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:24:13.952925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820ecf5-7891-4605-a966-97f058f36d74 service placement] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:13.953390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820ecf5-7891-4605-a966-97f058f36d74 service placement] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:13.954391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820ecf5-7891-4605-a966-97f058f36d74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:13.956238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c820ecf5-7891-4605-a966-97f058f36d74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:13.968291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820ecf5-7891-4605-a966-97f058f36d74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:24:13.969889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820ecf5-7891-4605-a966-97f058f36d74 service placement] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:24:13.980435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1043/2098] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:24:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:24:19.033830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346e16f-5a96-4863-bf4c-c3caf2fcb0ff None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:19.034360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346e16f-5a96-4863-bf4c-c3caf2fcb0ff None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:19.034360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346e16f-5a96-4863-bf4c-c3caf2fcb0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:19.041806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=28 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:24:19.055134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3346e16f-5a96-4863-bf4c-c3caf2fcb0ff None None] MFA Rules not processed for user `24211a806cfa4ee6b72c2e7b6074d473`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:24:19.056483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3346e16f-5a96-4863-bf4c-c3caf2fcb0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:19.115333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1056/2099] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:24:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:24:23.976498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=73 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:24:28.543187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ef7e4-4645-4147-a017-3ea8e2f49c21 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:28.543960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ef7e4-4645-4147-a017-3ea8e2f49c21 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:28.543960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ef7e4-4645-4147-a017-3ea8e2f49c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:28.562562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-857ef7e4-4645-4147-a017-3ea8e2f49c21 None None] MFA Rules not processed for user `725cd0a3733f41eb803d687dcda404f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:24:28.563933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-857ef7e4-4645-4147-a017-3ea8e2f49c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:28.620751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1044/2100] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:24:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:24:29.106983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=24 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:24:38.613899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=25 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:24:43.220947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da19f7-3502-4989-9708-f9901be82613 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:43.221418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da19f7-3502-4989-9708-f9901be82613 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:43.221538 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da19f7-3502-4989-9708-f9901be82613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:43.242910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f6da19f7-3502-4989-9708-f9901be82613 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:24:43.244194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f6da19f7-3502-4989-9708-f9901be82613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:43.252009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1057/2101] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:24:43.273436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ef7e4-4645-4147-a017-3ea8e2f49c21 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:24:43.286765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ef7e4-4645-4147-a017-3ea8e2f49c21 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:24:43.292264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f518d-fd5c-45cf-ba4a-a3764c854d79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:24:43.292864 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f518d-fd5c-45cf-ba4a-a3764c854d79 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:43.293143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f518d-fd5c-45cf-ba4a-a3764c854d79 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:43.293417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f518d-fd5c-45cf-ba4a-a3764c854d79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:43.302101 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f518d-fd5c-45cf-ba4a-a3764c854d79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:24:43.303710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f518d-fd5c-45cf-ba4a-a3764c854d79 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:24:43.313266 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1045/2102] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:24:46.457876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d44b80-c66e-4120-98d6-3515402b785b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:46.458386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d44b80-c66e-4120-98d6-3515402b785b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:46.458480 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d44b80-c66e-4120-98d6-3515402b785b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:46.478945 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c5d44b80-c66e-4120-98d6-3515402b785b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:24:46.480183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c5d44b80-c66e-4120-98d6-3515402b785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:46.489133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1058/2103] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:24:46.523227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f518d-fd5c-45cf-ba4a-a3764c854d79 service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:24:46.535068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f518d-fd5c-45cf-ba4a-a3764c854d79 service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:24:46.541529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d96fc-d543-4ae1-875c-5a04c1ce026b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:24:46.542170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d96fc-d543-4ae1-875c-5a04c1ce026b service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:46.542449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d96fc-d543-4ae1-875c-5a04c1ce026b service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:46.542718 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d96fc-d543-4ae1-875c-5a04c1ce026b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:46.551841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d96fc-d543-4ae1-875c-5a04c1ce026b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:24:46.553897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d96fc-d543-4ae1-875c-5a04c1ce026b service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:24:46.565505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1046/2104] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:24:50.678026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14035a0-8b5d-483d-838d-a37176bbfb7f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:50.678547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14035a0-8b5d-483d-838d-a37176bbfb7f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:50.678547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14035a0-8b5d-483d-838d-a37176bbfb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:50.698420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a14035a0-8b5d-483d-838d-a37176bbfb7f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:24:50.699993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a14035a0-8b5d-483d-838d-a37176bbfb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:50.708260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1059/2105] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:24:50.733317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d96fc-d543-4ae1-875c-5a04c1ce026b service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:24:50.744707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d96fc-d543-4ae1-875c-5a04c1ce026b service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:24:50.750331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa793b5-f0b7-4798-bcae-feb45af7f9a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:24:50.751597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa793b5-f0b7-4798-bcae-feb45af7f9a2 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:50.751880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa793b5-f0b7-4798-bcae-feb45af7f9a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:50.752429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa793b5-f0b7-4798-bcae-feb45af7f9a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:50.760972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa793b5-f0b7-4798-bcae-feb45af7f9a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:24:50.762549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa793b5-f0b7-4798-bcae-feb45af7f9a2 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:24:50.775049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1047/2106] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:24:51.989728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37351d60-073d-4c82-9df4-8da2ec67b565 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:51.990248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37351d60-073d-4c82-9df4-8da2ec67b565 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:51.990346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37351d60-073d-4c82-9df4-8da2ec67b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:52.009021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-37351d60-073d-4c82-9df4-8da2ec67b565 None None] MFA Rules not processed for user `84af08afd232473b8c1c83ac3f0dee3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:24:52.010210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-37351d60-073d-4c82-9df4-8da2ec67b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:52.065718 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1060/2107] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:24:55.839813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e772a2d-b972-4a0a-99af-3bce427cfe83 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:55.840413 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e772a2d-b972-4a0a-99af-3bce427cfe83 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:55.840413 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e772a2d-b972-4a0a-99af-3bce427cfe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:55.861797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9e772a2d-b972-4a0a-99af-3bce427cfe83 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:24:55.863049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9e772a2d-b972-4a0a-99af-3bce427cfe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:24:55.871003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1048/2108] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:24:55.893509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37351d60-073d-4c82-9df4-8da2ec67b565 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:24:55.905908 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37351d60-073d-4c82-9df4-8da2ec67b565 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:24:55.911645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0b25-3890-4c85-bc1e-d4beab5ad24f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:24:55.912237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0b25-3890-4c85-bc1e-d4beab5ad24f service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:24:55.912518 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0b25-3890-4c85-bc1e-d4beab5ad24f service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:24:55.912794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0b25-3890-4c85-bc1e-d4beab5ad24f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:24:55.921062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c0b25-3890-4c85-bc1e-d4beab5ad24f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:24:55.923129 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c0b25-3890-4c85-bc1e-d4beab5ad24f service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:24:55.932475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1061/2109] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:25:01.068361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d73654-db83-4c41-9529-255bad468998 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:25:01.068814 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d73654-db83-4c41-9529-255bad468998 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:25:01.068928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d73654-db83-4c41-9529-255bad468998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:25:01.088714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-58d73654-db83-4c41-9529-255bad468998 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:25:01.089926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-58d73654-db83-4c41-9529-255bad468998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:25:01.097995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1049/2110] 10.222.0.42 () {58 vars in 1016 bytes} [Fri Oct 21 21:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:25:01.120769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0b25-3890-4c85-bc1e-d4beab5ad24f service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:25:01.133252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0b25-3890-4c85-bc1e-d4beab5ad24f service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:25:01.138792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293edb21-7d2f-409f-81d5-f679a93e9008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:25:01.139437 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293edb21-7d2f-409f-81d5-f679a93e9008 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:25:01.139718 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293edb21-7d2f-409f-81d5-f679a93e9008 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:25:01.140194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293edb21-7d2f-409f-81d5-f679a93e9008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:25:01.148837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293edb21-7d2f-409f-81d5-f679a93e9008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:25:01.150415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293edb21-7d2f-409f-81d5-f679a93e9008 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:25:01.160366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1062/2111] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:25:11.083079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=24 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:25:11.155735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=46 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:25:32.479214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965cf95-e491-4122-924a-a4a2b3638f3f None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:25:32.479797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965cf95-e491-4122-924a-a4a2b3638f3f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:25:32.480236 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965cf95-e491-4122-924a-a4a2b3638f3f None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:25:32.481754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1050/2112] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:25:32.510504 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d39dc9-c3eb-4a3f-ab10-b3c0a3b5190f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:25:32.511683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d39dc9-c3eb-4a3f-ab10-b3c0a3b5190f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:25:32.512223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d39dc9-c3eb-4a3f-ab10-b3c0a3b5190f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:25:32.551333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c3d39dc9-c3eb-4a3f-ab10-b3c0a3b5190f None None] MFA Rules not processed for user `aa89e84c708f44c299c728284e33fabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:25:32.552884 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c3d39dc9-c3eb-4a3f-ab10-b3c0a3b5190f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:25:32.559777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965cf95-e491-4122-924a-a4a2b3638f3f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:25:32.564510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1063/2113] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:25:32.567786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8965cf95-e491-4122-924a-a4a2b3638f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:25:32.578008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d39dc9-c3eb-4a3f-ab10-b3c0a3b5190f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:25:32.579600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c3d39dc9-c3eb-4a3f-ab10-b3c0a3b5190f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:25:32.589530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965cf95-e491-4122-924a-a4a2b3638f3f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:25:32.594439 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d39dc9-c3eb-4a3f-ab10-b3c0a3b5190f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:25:32.595031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:25:32.595896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:25:32.596180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:25:32.596453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] PATH_INFO: `/v3/users/725cd0a3733f41eb803d687dcda404f2` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:25:32.597795 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=725cd0a3733f41eb803d687dcda404f2)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:25:32.600152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:25:32.600546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f8799-fef0-452f-8e5a-afd9dcd37fd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa89e84c708f44c299c728284e33fabf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:25:32.601151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f8799-fef0-452f-8e5a-afd9dcd37fd5 service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:25:32.601427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f8799-fef0-452f-8e5a-afd9dcd37fd5 service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:25:32.601696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f8799-fef0-452f-8e5a-afd9dcd37fd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:25:32.610843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f8799-fef0-452f-8e5a-afd9dcd37fd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:25:32.612443 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f8799-fef0-452f-8e5a-afd9dcd37fd5 service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:25:32.622788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1064/2114] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:25:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:25:32.658892 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725cd0a3733f41eb803d687dcda404f2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:25:32.665914 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725cd0a3733f41eb803d687dcda404f2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:25:32.673956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725cd0a3733f41eb803d687dcda404f2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:25:32.685832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725cd0a3733f41eb803d687dcda404f2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:25:32.686500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b7af931c-38e2-490a-a0dd-e28826312f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725cd0a3733f41eb803d687dcda404f2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:25:32.692963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1051/2115] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:25:32 2022] DELETE /identity/v3/users/725cd0a3733f41eb803d687dcda404f2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:25:33.293903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f8799-fef0-452f-8e5a-afd9dcd37fd5 service placement] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:25:33.304700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f8799-fef0-452f-8e5a-afd9dcd37fd5 service placement] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:25:33.351262 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a5798-16e1-44c7-bee2-127e86d011a6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:25:33.351584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a5798-16e1-44c7-bee2-127e86d011a6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:25:33.351861 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a5798-16e1-44c7-bee2-127e86d011a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:25:33.371968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ae1a5798-16e1-44c7-bee2-127e86d011a6 None None] MFA Rules not processed for user `24211a806cfa4ee6b72c2e7b6074d473`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:25:33.373318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ae1a5798-16e1-44c7-bee2-127e86d011a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:25:33.376566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:25:33.377209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:25:33.377480 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:25:33.377747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] PATH_INFO: `/v3/projects/87a5d3ac4d714a1e8da408d03f976e87` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:25:33.378853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a5d3ac4d714a1e8da408d03f976e87)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:25:33.380792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:25:33.428478 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a5d3ac4d714a1e8da408d03f976e87', 'request_id': 'req-54465aa6-67c9-407a-8492-08446cf2b19b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:25:33.430422 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1052/2116] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:25:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:25:33.434845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a5d3ac4d714a1e8da408d03f976e87', 'request_id': 'req-54465aa6-67c9-407a-8492-08446cf2b19b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:25:33.441282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a5d3ac4d714a1e8da408d03f976e87', 'request_id': 'req-54465aa6-67c9-407a-8492-08446cf2b19b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:25:33.456108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] The token cache is being invalidate because project 87a5d3ac4d714a1e8da408d03f976e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:25:33.456417 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:25:33.457053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:25:33.458526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1065/2117] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:25:33 2022] DELETE /identity/v3/projects/87a5d3ac4d714a1e8da408d03f976e87 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:25:43.423634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:25:43.452541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:25:56.561231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a5798-16e1-44c7-bee2-127e86d011a6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:25:56.562733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ae1a5798-16e1-44c7-bee2-127e86d011a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:25:56.631414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a5798-16e1-44c7-bee2-127e86d011a6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:25:56.686297 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248eccc-d8f9-4336-a36e-82958eca80cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:25:56.686914 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248eccc-d8f9-4336-a36e-82958eca80cd service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:25:56.687199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248eccc-d8f9-4336-a36e-82958eca80cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:25:56.687484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248eccc-d8f9-4336-a36e-82958eca80cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:25:56.689254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d248eccc-d8f9-4336-a36e-82958eca80cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:25:56.756984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248eccc-d8f9-4336-a36e-82958eca80cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:25:56.758503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248eccc-d8f9-4336-a36e-82958eca80cd service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:25:56.770039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1053/2118] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:25:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:25:57.141976 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:25:57.143624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:25:57.160369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54465aa6-67c9-407a-8492-08446cf2b19b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:25:57.166078 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1b0f9-ff70-487c-9ac2-be2ee36a78c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:25:57.167568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1b0f9-ff70-487c-9ac2-be2ee36a78c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:25:57.167568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1b0f9-ff70-487c-9ac2-be2ee36a78c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:25:57.167568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1b0f9-ff70-487c-9ac2-be2ee36a78c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:25:57.169687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a0c1b0f9-ff70-487c-9ac2-be2ee36a78c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:25:57.186275 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1b0f9-ff70-487c-9ac2-be2ee36a78c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:25:57.188873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1b0f9-ff70-487c-9ac2-be2ee36a78c4 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:25:57.206303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1066/2119] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:25:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:00.323781 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ceaea-bd9d-4b8b-a0c4-5fd53c3fa7d7 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:00.324618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ceaea-bd9d-4b8b-a0c4-5fd53c3fa7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:00.324758 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ceaea-bd9d-4b8b-a0c4-5fd53c3fa7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:00.345587 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-289ceaea-bd9d-4b8b-a0c4-5fd53c3fa7d7 None None] MFA Rules not processed for user `54d2608c7c8e4d7581fd9a944d8f18e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:00.346789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-289ceaea-bd9d-4b8b-a0c4-5fd53c3fa7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:00.401290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1054/2120] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:02.858472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1b0f9-ff70-487c-9ac2-be2ee36a78c4 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:02.860747 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a0c1b0f9-ff70-487c-9ac2-be2ee36a78c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:02.874611 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1b0f9-ff70-487c-9ac2-be2ee36a78c4 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:02.880280 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9b349-b1b4-4981-b0ef-9fdeafa70e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:02.880930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9b349-b1b4-4981-b0ef-9fdeafa70e7e service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:02.881208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9b349-b1b4-4981-b0ef-9fdeafa70e7e service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:02.881481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9b349-b1b4-4981-b0ef-9fdeafa70e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:02.883218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-19b9b349-b1b4-4981-b0ef-9fdeafa70e7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:02.941393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9b349-b1b4-4981-b0ef-9fdeafa70e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:02.942974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9b349-b1b4-4981-b0ef-9fdeafa70e7e service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:02.952174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1067/2121] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:07.649809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ceaea-bd9d-4b8b-a0c4-5fd53c3fa7d7 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:07.654887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:07.660980 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ceaea-bd9d-4b8b-a0c4-5fd53c3fa7d7 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:07.664786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104cd77-c648-4feb-9dc3-d64cb4e75898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:07.665508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104cd77-c648-4feb-9dc3-d64cb4e75898 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:07.665886 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104cd77-c648-4feb-9dc3-d64cb4e75898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:07.666256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104cd77-c648-4feb-9dc3-d64cb4e75898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:07.668964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4104cd77-c648-4feb-9dc3-d64cb4e75898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:07.802733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104cd77-c648-4feb-9dc3-d64cb4e75898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:07.805276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104cd77-c648-4feb-9dc3-d64cb4e75898 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:07.831190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1055/2122] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:26:07.889722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc67ac-4b35-453a-94c0-571917d21b04 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:07.890245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc67ac-4b35-453a-94c0-571917d21b04 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:07.890245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc67ac-4b35-453a-94c0-571917d21b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:07.911163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-29bc67ac-4b35-453a-94c0-571917d21b04 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:07.912835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-29bc67ac-4b35-453a-94c0-571917d21b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:07.978725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1068/2123] 10.222.0.23 () {58 vars in 967 bytes} [Fri Oct 21 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:08.028018 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104cd77-c648-4feb-9dc3-d64cb4e75898 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:08.029423 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4104cd77-c648-4feb-9dc3-d64cb4e75898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:08.109353 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104cd77-c648-4feb-9dc3-d64cb4e75898 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:08.115502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cb795-41d0-46ed-b59e-68bae4aa5ff1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:08.116489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cb795-41d0-46ed-b59e-68bae4aa5ff1 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:08.116750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cb795-41d0-46ed-b59e-68bae4aa5ff1 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:08.117109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cb795-41d0-46ed-b59e-68bae4aa5ff1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:08.129094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cb795-41d0-46ed-b59e-68bae4aa5ff1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:08.130681 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cb795-41d0-46ed-b59e-68bae4aa5ff1 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:08.139721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1056/2124] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:26:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:26:13.068442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc67ac-4b35-453a-94c0-571917d21b04 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:13.070027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-29bc67ac-4b35-453a-94c0-571917d21b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:13.088209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc67ac-4b35-453a-94c0-571917d21b04 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:13.094596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:13.095616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:13.096103 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:13.096663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] PATH_INFO: `/v3/users/84af08afd232473b8c1c83ac3f0dee3d` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:13.098091 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=84af08afd232473b8c1c83ac3f0dee3d)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:13.100193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:13.177845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84af08afd232473b8c1c83ac3f0dee3d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:13.178803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84af08afd232473b8c1c83ac3f0dee3d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:13.191287 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84af08afd232473b8c1c83ac3f0dee3d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:13.198971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84af08afd232473b8c1c83ac3f0dee3d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:13.200379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f3279c9-9471-4871-954b-bcd3d2ac0bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84af08afd232473b8c1c83ac3f0dee3d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:13.218967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1069/2125] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:26:13 2022] DELETE /identity/v3/users/84af08afd232473b8c1c83ac3f0dee3d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:13.583177 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cb795-41d0-46ed-b59e-68bae4aa5ff1 service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:13.595926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cb795-41d0-46ed-b59e-68bae4aa5ff1 service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:13.692553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:13.693331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:13.693686 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:13.694041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] PATH_INFO: `/v3/projects/e91f5d5bf6c5425aad7c429941ae6aa8` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:13.695307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91f5d5bf6c5425aad7c429941ae6aa8)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:13.697511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:13.732897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:13.751337 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91f5d5bf6c5425aad7c429941ae6aa8', 'request_id': 'req-2edba654-032f-4b8e-8dea-7edf4f889abb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:13.761048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91f5d5bf6c5425aad7c429941ae6aa8', 'request_id': 'req-2edba654-032f-4b8e-8dea-7edf4f889abb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:13.769131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91f5d5bf6c5425aad7c429941ae6aa8', 'request_id': 'req-2edba654-032f-4b8e-8dea-7edf4f889abb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:13.782564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] The token cache is being invalidate because project e91f5d5bf6c5425aad7c429941ae6aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:13.782975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:13.783697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2edba654-032f-4b8e-8dea-7edf4f889abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:13.785210 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1057/2126] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:13 2022] DELETE /identity/v3/projects/e91f5d5bf6c5425aad7c429941ae6aa8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:13.790273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ab5b5-7519-4fcb-9506-78361fa9b538 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:13.790653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ab5b5-7519-4fcb-9506-78361fa9b538 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:13.791127 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ab5b5-7519-4fcb-9506-78361fa9b538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:13.798898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:13.817849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-740ab5b5-7519-4fcb-9506-78361fa9b538 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:13.819250 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-740ab5b5-7519-4fcb-9506-78361fa9b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:13.891238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1070/2127] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:26:13.898786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72bc3b-1dfb-4507-8a1f-437d1eb44857 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:13.899251 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72bc3b-1dfb-4507-8a1f-437d1eb44857 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:13.899722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72bc3b-1dfb-4507-8a1f-437d1eb44857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:13.920739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-fd72bc3b-1dfb-4507-8a1f-437d1eb44857 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:13.922042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fd72bc3b-1dfb-4507-8a1f-437d1eb44857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:13.930156 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1058/2128] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:13.934703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ab5b5-7519-4fcb-9506-78361fa9b538 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:13.947029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ab5b5-7519-4fcb-9506-78361fa9b538 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:13.955420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5180d9d-0a92-44b0-bbd5-0e90754c508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:13.956290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5180d9d-0a92-44b0-bbd5-0e90754c508f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:13.956998 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5180d9d-0a92-44b0-bbd5-0e90754c508f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:13.957381 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5180d9d-0a92-44b0-bbd5-0e90754c508f admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:13.958332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5180d9d-0a92-44b0-bbd5-0e90754c508f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:26:13.958759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5180d9d-0a92-44b0-bbd5-0e90754c508f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:13.961133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5180d9d-0a92-44b0-bbd5-0e90754c508f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:13.979773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1071/2129] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:26:13.980943 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72bc3b-1dfb-4507-8a1f-437d1eb44857 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:13.991365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72bc3b-1dfb-4507-8a1f-437d1eb44857 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:13.996490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa150bb9-5293-412c-a760-37227b10d168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:13.997322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150bb9-5293-412c-a760-37227b10d168 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:13.997669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150bb9-5293-412c-a760-37227b10d168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:13.998033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150bb9-5293-412c-a760-37227b10d168 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:13.998857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa150bb9-5293-412c-a760-37227b10d168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:14.001072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa150bb9-5293-412c-a760-37227b10d168 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:14.037524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1059/2130] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:26:13 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:14.038687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5180d9d-0a92-44b0-bbd5-0e90754c508f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:14.048765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5180d9d-0a92-44b0-bbd5-0e90754c508f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:14.121035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8c5d9-cd9d-4f52-b1ff-bc5d7b4eca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:14.121751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8c5d9-cd9d-4f52-b1ff-bc5d7b4eca58 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:14.122141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8c5d9-cd9d-4f52-b1ff-bc5d7b4eca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:14.122794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8c5d9-cd9d-4f52-b1ff-bc5d7b4eca58 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:14.123246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8c5d9-cd9d-4f52-b1ff-bc5d7b4eca58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:14.125833 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8c5d9-cd9d-4f52-b1ff-bc5d7b4eca58 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:14.149629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1072/2131] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:26:14 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:26:14.153584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa150bb9-5293-412c-a760-37227b10d168 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:14.165340 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa150bb9-5293-412c-a760-37227b10d168 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:14.170611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe2f1a-7a0b-4006-b281-cfad4ae73391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:14.171226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe2f1a-7a0b-4006-b281-cfad4ae73391 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:14.171540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe2f1a-7a0b-4006-b281-cfad4ae73391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:14.171794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe2f1a-7a0b-4006-b281-cfad4ae73391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:14.172483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe2f1a-7a0b-4006-b281-cfad4ae73391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:14.174118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe2f1a-7a0b-4006-b281-cfad4ae73391 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:14.188524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1060/2132] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:26:14.192392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8c5d9-cd9d-4f52-b1ff-bc5d7b4eca58 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:14.203782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8c5d9-cd9d-4f52-b1ff-bc5d7b4eca58 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:14.210446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e20124-8267-4421-893f-d8264c881e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:14.211128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e20124-8267-4421-893f-d8264c881e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:14.211517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e20124-8267-4421-893f-d8264c881e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:14.212004 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e20124-8267-4421-893f-d8264c881e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:14.212729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e20124-8267-4421-893f-d8264c881e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:14.214407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e20124-8267-4421-893f-d8264c881e9d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:14.231905 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe2f1a-7a0b-4006-b281-cfad4ae73391 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:14.237646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1073/2133] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:14.244653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe2f1a-7a0b-4006-b281-cfad4ae73391 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:14.260123 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84eb73-0a1e-48b1-b0bc-edef9fb1bd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:14.260902 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84eb73-0a1e-48b1-b0bc-edef9fb1bd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:14.261314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84eb73-0a1e-48b1-b0bc-edef9fb1bd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:14.261709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84eb73-0a1e-48b1-b0bc-edef9fb1bd5d admin admin] PATH_INFO: `/v3/projects/31696281b1f14258b1d88ef3372bc856/users/86069d1f932640e387038aebb2b1b672/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:14.284298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84eb73-0a1e-48b1-b0bc-edef9fb1bd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31696281b1f14258b1d88ef3372bc856, user_id=86069d1f932640e387038aebb2b1b672, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:14.287662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84eb73-0a1e-48b1-b0bc-edef9fb1bd5d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:14.309762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1061/2134] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:14 2022] PUT /identity/v3/projects/31696281b1f14258b1d88ef3372bc856/users/86069d1f932640e387038aebb2b1b672/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:26:14.312026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee409262-255a-47a6-98fc-36bed5f6c4d2 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:14.313088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee409262-255a-47a6-98fc-36bed5f6c4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:14.313547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee409262-255a-47a6-98fc-36bed5f6c4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:14.341728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ee409262-255a-47a6-98fc-36bed5f6c4d2 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:14.342979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ee409262-255a-47a6-98fc-36bed5f6c4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:14.432862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1074/2135] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:14.441022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84eb73-0a1e-48b1-b0bc-edef9fb1bd5d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:14.443236 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1a84eb73-0a1e-48b1-b0bc-edef9fb1bd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:14.531299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84eb73-0a1e-48b1-b0bc-edef9fb1bd5d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:14.535421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb1b58-1751-4af8-b202-afbd2d75e154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:14.536249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb1b58-1751-4af8-b202-afbd2d75e154 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:14.536677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb1b58-1751-4af8-b202-afbd2d75e154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:14.537124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb1b58-1751-4af8-b202-afbd2d75e154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:14.547476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb1b58-1751-4af8-b202-afbd2d75e154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:14.549806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb1b58-1751-4af8-b202-afbd2d75e154 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:14.565700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1062/2136] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:17.298384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee409262-255a-47a6-98fc-36bed5f6c4d2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:17.300310 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ee409262-255a-47a6-98fc-36bed5f6c4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:17.321486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee409262-255a-47a6-98fc-36bed5f6c4d2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:17.329491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:17.330142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:17.330786 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:17.331246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] PATH_INFO: `/v3/users/e56aa4551f214e8082dd8ab0808e6ed7` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:17.332610 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56aa4551f214e8082dd8ab0808e6ed7)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:17.334724 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:17.340999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:17.429278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb1b58-1751-4af8-b202-afbd2d75e154 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:17.431133 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d6fb1b58-1751-4af8-b202-afbd2d75e154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:17.446700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56aa4551f214e8082dd8ab0808e6ed7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:17.447694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56aa4551f214e8082dd8ab0808e6ed7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:17.448507 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb1b58-1751-4af8-b202-afbd2d75e154 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:17.455780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835dfcb-324f-43d5-b09c-7aad7122c30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:17.457148 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835dfcb-324f-43d5-b09c-7aad7122c30f service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:17.458045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835dfcb-324f-43d5-b09c-7aad7122c30f service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:17.458887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835dfcb-324f-43d5-b09c-7aad7122c30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:17.460442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56aa4551f214e8082dd8ab0808e6ed7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:17.461965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9835dfcb-324f-43d5-b09c-7aad7122c30f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:17.480330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835dfcb-324f-43d5-b09c-7aad7122c30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:17.481402 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56aa4551f214e8082dd8ab0808e6ed7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:17.482399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56aa4551f214e8082dd8ab0808e6ed7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:17.483030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835dfcb-324f-43d5-b09c-7aad7122c30f service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:17.493463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1063/2137] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:17.510276 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1075/2138] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:26:17 2022] DELETE /identity/v3/users/e56aa4551f214e8082dd8ab0808e6ed7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:17.768453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835dfcb-324f-43d5-b09c-7aad7122c30f service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:17.793689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835dfcb-324f-43d5-b09c-7aad7122c30f service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:17.852869 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:17.882434 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:17.883546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:17.884025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:17.884493 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] PATH_INFO: `/v3/projects/95949a8290a14149abdfebfdb98dcb2e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:17.885877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95949a8290a14149abdfebfdb98dcb2e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:17.888753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:17.993066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95949a8290a14149abdfebfdb98dcb2e', 'request_id': 'req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.003786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95949a8290a14149abdfebfdb98dcb2e', 'request_id': 'req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.015158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95949a8290a14149abdfebfdb98dcb2e', 'request_id': 'req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.031015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] The token cache is being invalidate because project 95949a8290a14149abdfebfdb98dcb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:18.032039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.032776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.035391 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1064/2139] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:17 2022] DELETE /identity/v3/projects/95949a8290a14149abdfebfdb98dcb2e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:18.039464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:18.041502 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:18.063106 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c32a-24cb-48e4-956b-ea83e5ad7efa admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:18.152405 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:18.152979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:18.153351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:18.153717 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] PATH_INFO: `/v3/users/2b3798715105436b8753998c258b136e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:18.155118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3798715105436b8753998c258b136e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:18.157728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:18.230731 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3798715105436b8753998c258b136e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.232314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3798715105436b8753998c258b136e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.244317 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3798715105436b8753998c258b136e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.259943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3798715105436b8753998c258b136e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.261752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-22396229-3686-4763-96c8-1299e0eaac36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3798715105436b8753998c258b136e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.301033 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:18.325757 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1076/2140] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:26:18 2022] DELETE /identity/v3/users/2b3798715105436b8753998c258b136e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:26:18.545379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:18.547650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:18.568671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8330-4669-49fd-b70e-e84b9fcbb9e7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:18.670716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:18.671553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:18.672458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:18.672786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] PATH_INFO: `/v3/projects/3cb632fc62654941898ec80665876520` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:18.674478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb632fc62654941898ec80665876520)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:18.678620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:18.749705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb632fc62654941898ec80665876520', 'request_id': 'req-6bc615d1-9d94-4fe5-9efa-4c632073998b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.759936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb632fc62654941898ec80665876520', 'request_id': 'req-6bc615d1-9d94-4fe5-9efa-4c632073998b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.768044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb632fc62654941898ec80665876520', 'request_id': 'req-6bc615d1-9d94-4fe5-9efa-4c632073998b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.784372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] The token cache is being invalidate because project 3cb632fc62654941898ec80665876520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:18.784683 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.785485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:18.789118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1065/2141] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:18 2022] DELETE /identity/v3/projects/3cb632fc62654941898ec80665876520 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:26:20.239338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0a134-1140-43b3-9bf7-ee96269198bd None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:20.240440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0a134-1140-43b3-9bf7-ee96269198bd None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:20.240943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0a134-1140-43b3-9bf7-ee96269198bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:20.272524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-eaa0a134-1140-43b3-9bf7-ee96269198bd None None] MFA Rules not processed for user `86069d1f932640e387038aebb2b1b672`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:20.273782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-eaa0a134-1140-43b3-9bf7-ee96269198bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:20.340264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1077/2142] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:20.354480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:20.356012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:20.361388 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:20.430795 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc615d1-9d94-4fe5-9efa-4c632073998b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:20.436416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df2f0-2185-4914-a1c9-ae5b457304ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:20.437056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df2f0-2185-4914-a1c9-ae5b457304ee service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:20.437891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df2f0-2185-4914-a1c9-ae5b457304ee service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:20.438161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df2f0-2185-4914-a1c9-ae5b457304ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:20.446571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80df2f0-2185-4914-a1c9-ae5b457304ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:20.448206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80df2f0-2185-4914-a1c9-ae5b457304ee service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:20.459519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1066/2143] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:21.731119 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19d62e-39a9-4c5d-85a4-8a02ac26e275 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:21.731753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19d62e-39a9-4c5d-85a4-8a02ac26e275 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:21.731753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19d62e-39a9-4c5d-85a4-8a02ac26e275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:21.751988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-bc19d62e-39a9-4c5d-85a4-8a02ac26e275 None None] MFA Rules not processed for user `86069d1f932640e387038aebb2b1b672`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:21.753188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bc19d62e-39a9-4c5d-85a4-8a02ac26e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:21.760243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1078/2144] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:22.071639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df2f0-2185-4914-a1c9-ae5b457304ee service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:22.073087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a80df2f0-2185-4914-a1c9-ae5b457304ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:22.142382 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df2f0-2185-4914-a1c9-ae5b457304ee service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:22.165492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9483c05-5812-4949-a575-e2461d8a9b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:22.166125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9483c05-5812-4949-a575-e2461d8a9b82 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:22.166403 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9483c05-5812-4949-a575-e2461d8a9b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:22.166666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9483c05-5812-4949-a575-e2461d8a9b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:22.169043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c9483c05-5812-4949-a575-e2461d8a9b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:22.180231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9483c05-5812-4949-a575-e2461d8a9b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:22.181657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9483c05-5812-4949-a575-e2461d8a9b82 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:22.190071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1067/2145] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:22.599902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19d62e-39a9-4c5d-85a4-8a02ac26e275 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:22.601391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bc19d62e-39a9-4c5d-85a4-8a02ac26e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:22.677517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19d62e-39a9-4c5d-85a4-8a02ac26e275 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:22.682292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6031f8-eaad-4cbd-97d0-cf6caee9c17e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa89e84c708f44c299c728284e33fabf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:22.683007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6031f8-eaad-4cbd-97d0-cf6caee9c17e service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:22.683382 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6031f8-eaad-4cbd-97d0-cf6caee9c17e service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:22.683725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6031f8-eaad-4cbd-97d0-cf6caee9c17e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:22.685461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ec6031f8-eaad-4cbd-97d0-cf6caee9c17e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:22.698023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6031f8-eaad-4cbd-97d0-cf6caee9c17e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:22.699923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6031f8-eaad-4cbd-97d0-cf6caee9c17e service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:22.711094 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1079/2146] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:22.911327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9483c05-5812-4949-a575-e2461d8a9b82 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:22.912901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c9483c05-5812-4949-a575-e2461d8a9b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:22.932163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9483c05-5812-4949-a575-e2461d8a9b82 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:22.939640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49adb9-bcf6-44a7-9f67-d5abc075c1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:22.941086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49adb9-bcf6-44a7-9f67-d5abc075c1ed service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:22.941821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49adb9-bcf6-44a7-9f67-d5abc075c1ed service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:22.942107 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49adb9-bcf6-44a7-9f67-d5abc075c1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:22.944011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9a49adb9-bcf6-44a7-9f67-d5abc075c1ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:23.011750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49adb9-bcf6-44a7-9f67-d5abc075c1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:23.013342 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49adb9-bcf6-44a7-9f67-d5abc075c1ed service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:23.023836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1068/2147] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:32.706521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=67 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:32.713486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6031f8-eaad-4cbd-97d0-cf6caee9c17e service placement] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:32.729551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6031f8-eaad-4cbd-97d0-cf6caee9c17e service placement] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:32.736600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d822f-7e53-4941-8060-59325a790bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:32.737171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d822f-7e53-4941-8060-59325a790bd8 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:32.737438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d822f-7e53-4941-8060-59325a790bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:32.737745 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d822f-7e53-4941-8060-59325a790bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:32.739800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a05d822f-7e53-4941-8060-59325a790bd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:32.753755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d822f-7e53-4941-8060-59325a790bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:32.755898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d822f-7e53-4941-8060-59325a790bd8 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:32.767649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1080/2148] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:26:33.019425 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=87 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:36.344960 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49adb9-bcf6-44a7-9f67-d5abc075c1ed service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:36.354996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49adb9-bcf6-44a7-9f67-d5abc075c1ed service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:36.358727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0d72e-ac65-4fac-b0ff-e5db7a151daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:36.359363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0d72e-ac65-4fac-b0ff-e5db7a151daf service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:36.360293 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0d72e-ac65-4fac-b0ff-e5db7a151daf service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:36.360577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0d72e-ac65-4fac-b0ff-e5db7a151daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:36.365937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9af0d72e-ac65-4fac-b0ff-e5db7a151daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:36.384020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0d72e-ac65-4fac-b0ff-e5db7a151daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:36.386400 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0d72e-ac65-4fac-b0ff-e5db7a151daf service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:36.397229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1069/2149] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:36.526874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f338e-eeda-4b5c-9fab-5d522c2f0156 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:36.527411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f338e-eeda-4b5c-9fab-5d522c2f0156 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:36.527411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f338e-eeda-4b5c-9fab-5d522c2f0156 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:36.528780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1081/2150] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:26:36.535245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b468937-a7f1-4847-a049-f4c3297fa6c2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:36.535589 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b468937-a7f1-4847-a049-f4c3297fa6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:36.535868 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b468937-a7f1-4847-a049-f4c3297fa6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:36.556444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2b468937-a7f1-4847-a049-f4c3297fa6c2 None None] MFA Rules not processed for user `ad7ef5b260e4425c93ebbe85570136db`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:36.557756 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2b468937-a7f1-4847-a049-f4c3297fa6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:36.565131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1070/2151] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:26:36.578551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f338e-eeda-4b5c-9fab-5d522c2f0156 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:36.580378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a04f338e-eeda-4b5c-9fab-5d522c2f0156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:36.593461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f338e-eeda-4b5c-9fab-5d522c2f0156 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:36.597931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1588b-c90f-4969-bee4-a99ed1cfcec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:36.598640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1588b-c90f-4969-bee4-a99ed1cfcec4 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:36.598988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1588b-c90f-4969-bee4-a99ed1cfcec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:36.599386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1588b-c90f-4969-bee4-a99ed1cfcec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:36.606942 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1588b-c90f-4969-bee4-a99ed1cfcec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:36.608553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1588b-c90f-4969-bee4-a99ed1cfcec4 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:36.617317 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1082/2152] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:26:36.704049 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af7442-5448-45dc-9f40-fe25cd3fa356 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:36.704339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af7442-5448-45dc-9f40-fe25cd3fa356 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:36.704666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af7442-5448-45dc-9f40-fe25cd3fa356 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:36.706064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1071/2153] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 21 21:26:36.711511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690929e5-4bcb-4eae-a628-a3c0f18e1c29 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:36.711798 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690929e5-4bcb-4eae-a628-a3c0f18e1c29 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:36.712102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690929e5-4bcb-4eae-a628-a3c0f18e1c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:36.732205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-690929e5-4bcb-4eae-a628-a3c0f18e1c29 None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:36.733404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-690929e5-4bcb-4eae-a628-a3c0f18e1c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:36.743165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1083/2154] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:36.753815 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af7442-5448-45dc-9f40-fe25cd3fa356 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:36.764631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af7442-5448-45dc-9f40-fe25cd3fa356 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:36.768174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bcb8e-a955-46d9-82f4-57e2c3e5754e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:36.768761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bcb8e-a955-46d9-82f4-57e2c3e5754e service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:36.769036 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bcb8e-a955-46d9-82f4-57e2c3e5754e service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:36.769304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bcb8e-a955-46d9-82f4-57e2c3e5754e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:36.779242 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bcb8e-a955-46d9-82f4-57e2c3e5754e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:36.780629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bcb8e-a955-46d9-82f4-57e2c3e5754e service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:36.791641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1072/2155] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:38.831612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690929e5-4bcb-4eae-a628-a3c0f18e1c29 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:38.846121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690929e5-4bcb-4eae-a628-a3c0f18e1c29 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:38.860645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880ce12-0a94-468f-9fa9-6d7050e10319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:38.861942 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880ce12-0a94-468f-9fa9-6d7050e10319 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:38.862338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880ce12-0a94-468f-9fa9-6d7050e10319 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:38.862984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880ce12-0a94-468f-9fa9-6d7050e10319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:38.865781 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5880ce12-0a94-468f-9fa9-6d7050e10319 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:38.885497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880ce12-0a94-468f-9fa9-6d7050e10319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:38.889307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880ce12-0a94-468f-9fa9-6d7050e10319 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:38.909491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1084/2156] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:40.127228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bcb8e-a955-46d9-82f4-57e2c3e5754e service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:40.135689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bcb8e-a955-46d9-82f4-57e2c3e5754e service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:40.139287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b171a-855b-4ba6-9a75-dbcb5c27daa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:40.139885 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b171a-855b-4ba6-9a75-dbcb5c27daa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:40.140163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b171a-855b-4ba6-9a75-dbcb5c27daa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:40.140432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b171a-855b-4ba6-9a75-dbcb5c27daa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:40.142689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-304b171a-855b-4ba6-9a75-dbcb5c27daa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:40.208333 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b171a-855b-4ba6-9a75-dbcb5c27daa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:40.209940 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b171a-855b-4ba6-9a75-dbcb5c27daa8 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:40.222635 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1073/2157] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:43.536878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880ce12-0a94-468f-9fa9-6d7050e10319 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:43.538293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5880ce12-0a94-468f-9fa9-6d7050e10319 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:43.552312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880ce12-0a94-468f-9fa9-6d7050e10319 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:43.557477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:43.558217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:43.558589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:43.558999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] PATH_INFO: `/v3/users/24211a806cfa4ee6b72c2e7b6074d473` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:43.560292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24211a806cfa4ee6b72c2e7b6074d473)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:43.562210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:43.608897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24211a806cfa4ee6b72c2e7b6074d473'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:43.609632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24211a806cfa4ee6b72c2e7b6074d473'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:43.616825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24211a806cfa4ee6b72c2e7b6074d473'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:43.623766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24211a806cfa4ee6b72c2e7b6074d473'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:43.624387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a6fa8d1c-d179-496f-bbcf-be20bcda4d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24211a806cfa4ee6b72c2e7b6074d473'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:43.642712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1085/2158] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:26:43 2022] DELETE /identity/v3/users/24211a806cfa4ee6b72c2e7b6074d473 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:43.815200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b171a-855b-4ba6-9a75-dbcb5c27daa8 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:43.825370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b171a-855b-4ba6-9a75-dbcb5c27daa8 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:43.883405 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:43.884033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:43.884309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:43.884579 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] PATH_INFO: `/v3/projects/e28b2fee5e9043388c98a4f56d789f90` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:43.885668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28b2fee5e9043388c98a4f56d789f90)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:43.887768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:43.932221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28b2fee5e9043388c98a4f56d789f90', 'request_id': 'req-1b5064ba-fcac-4cba-9201-d1009eaddf29'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:43.939867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28b2fee5e9043388c98a4f56d789f90', 'request_id': 'req-1b5064ba-fcac-4cba-9201-d1009eaddf29'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:43.944559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:43.945794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28b2fee5e9043388c98a4f56d789f90', 'request_id': 'req-1b5064ba-fcac-4cba-9201-d1009eaddf29'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:43.960747 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] The token cache is being invalidate because project e28b2fee5e9043388c98a4f56d789f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:43.961265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:43.962253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1b5064ba-fcac-4cba-9201-d1009eaddf29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:43.964216 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1074/2159] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:43 2022] DELETE /identity/v3/projects/e28b2fee5e9043388c98a4f56d789f90 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:43.969509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd97e-46f3-4126-985b-e5d56bff0d2f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:43.969837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd97e-46f3-4126-985b-e5d56bff0d2f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:43.970153 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd97e-46f3-4126-985b-e5d56bff0d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:43.990215 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-450fd97e-46f3-4126-985b-e5d56bff0d2f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:43.991367 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-450fd97e-46f3-4126-985b-e5d56bff0d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:44.050000 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1086/2160] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:44.057814 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46897c-757b-4919-aca3-418771adbe0a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:44.058159 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46897c-757b-4919-aca3-418771adbe0a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:44.058613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46897c-757b-4919-aca3-418771adbe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:44.080415 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-de46897c-757b-4919-aca3-418771adbe0a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:44.081594 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-de46897c-757b-4919-aca3-418771adbe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:44.089482 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1075/2161] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:44.094304 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fd97e-46f3-4126-985b-e5d56bff0d2f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:44.103849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fd97e-46f3-4126-985b-e5d56bff0d2f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:44.108297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30313085-85f9-4f25-918b-706e697d3a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:44.108892 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30313085-85f9-4f25-918b-706e697d3a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:44.109306 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30313085-85f9-4f25-918b-706e697d3a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:44.110113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30313085-85f9-4f25-918b-706e697d3a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:44.110756 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30313085-85f9-4f25-918b-706e697d3a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:26:44.111052 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30313085-85f9-4f25-918b-706e697d3a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:44.112667 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30313085-85f9-4f25-918b-706e697d3a1c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:44.123890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1087/2162] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:26:44.127979 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46897c-757b-4919-aca3-418771adbe0a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:44.137110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46897c-757b-4919-aca3-418771adbe0a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:44.141955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43324958-e6ec-41fb-bc4b-9ad34847e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:44.142549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43324958-e6ec-41fb-bc4b-9ad34847e1dd admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:44.142831 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43324958-e6ec-41fb-bc4b-9ad34847e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:44.143100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43324958-e6ec-41fb-bc4b-9ad34847e1dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:44.143774 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43324958-e6ec-41fb-bc4b-9ad34847e1dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:44.145649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43324958-e6ec-41fb-bc4b-9ad34847e1dd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:44.172716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1076/2163] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:26:44 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:44.176759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30313085-85f9-4f25-918b-706e697d3a1c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:44.186436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30313085-85f9-4f25-918b-706e697d3a1c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:44.194988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:44.243194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3764e-b25f-4551-8582-1b0ccc6c039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:44.243784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3764e-b25f-4551-8582-1b0ccc6c039e admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:44.244069 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3764e-b25f-4551-8582-1b0ccc6c039e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:44.244348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3764e-b25f-4551-8582-1b0ccc6c039e admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:44.244980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3764e-b25f-4551-8582-1b0ccc6c039e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:44.246884 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3764e-b25f-4551-8582-1b0ccc6c039e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:44.268020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1088/2164] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:26:44 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:44.274096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43324958-e6ec-41fb-bc4b-9ad34847e1dd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:44.286340 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43324958-e6ec-41fb-bc4b-9ad34847e1dd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:44.291321 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c976573-4e3b-4454-8cc8-12327a135972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:44.291945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c976573-4e3b-4454-8cc8-12327a135972 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:44.292228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c976573-4e3b-4454-8cc8-12327a135972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:44.292501 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c976573-4e3b-4454-8cc8-12327a135972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:44.293139 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c976573-4e3b-4454-8cc8-12327a135972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:44.294743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c976573-4e3b-4454-8cc8-12327a135972 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:44.305835 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1077/2165] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:44.309755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3764e-b25f-4551-8582-1b0ccc6c039e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:44.319619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3764e-b25f-4551-8582-1b0ccc6c039e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:44.324485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a3f18-ba6f-4af4-b672-508c3a96a876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:44.325077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a3f18-ba6f-4af4-b672-508c3a96a876 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:44.325356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a3f18-ba6f-4af4-b672-508c3a96a876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:44.325631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a3f18-ba6f-4af4-b672-508c3a96a876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:44.326271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a3f18-ba6f-4af4-b672-508c3a96a876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:44.327898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a3f18-ba6f-4af4-b672-508c3a96a876 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:44.338278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1089/2166] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:44.342121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c976573-4e3b-4454-8cc8-12327a135972 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:44.352377 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c976573-4e3b-4454-8cc8-12327a135972 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:44.357226 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ed5ef-39ae-4f18-9127-3afc1b822872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:44.357865 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed5ef-39ae-4f18-9127-3afc1b822872 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:44.358143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed5ef-39ae-4f18-9127-3afc1b822872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:44.358417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed5ef-39ae-4f18-9127-3afc1b822872 admin admin] PATH_INFO: `/v3/projects/fbfc22d0a4ee445db52120181958fa09/users/7c423f9b97ca400ea55401fa553f58be/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:44.373478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ed5ef-39ae-4f18-9127-3afc1b822872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfc22d0a4ee445db52120181958fa09, user_id=7c423f9b97ca400ea55401fa553f58be, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:44.376189 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ed5ef-39ae-4f18-9127-3afc1b822872 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:44.388262 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1078/2167] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:44 2022] PUT /identity/v3/projects/fbfc22d0a4ee445db52120181958fa09/users/7c423f9b97ca400ea55401fa553f58be/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:44.393640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbb7c3-07e8-4f60-b063-a2068fd01da1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:44.393923 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbb7c3-07e8-4f60-b063-a2068fd01da1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:44.394200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbb7c3-07e8-4f60-b063-a2068fd01da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:44.413415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-39cbb7c3-07e8-4f60-b063-a2068fd01da1 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:44.414594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-39cbb7c3-07e8-4f60-b063-a2068fd01da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:44.472296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1090/2168] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:44.481792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ed5ef-39ae-4f18-9127-3afc1b822872 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:44.483541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-156ed5ef-39ae-4f18-9127-3afc1b822872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:44.538962 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ed5ef-39ae-4f18-9127-3afc1b822872 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:44.542569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5941be-b8b6-42fb-b4e1-f08a04bf4230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:44.543173 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5941be-b8b6-42fb-b4e1-f08a04bf4230 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:44.543499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5941be-b8b6-42fb-b4e1-f08a04bf4230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:44.543772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5941be-b8b6-42fb-b4e1-f08a04bf4230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:44.552813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5941be-b8b6-42fb-b4e1-f08a04bf4230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:44.554218 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5941be-b8b6-42fb-b4e1-f08a04bf4230 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:44.563504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1079/2169] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:45.192582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fcf2e-5516-4ec5-a30d-2ce1444fad47 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:45.193063 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fcf2e-5516-4ec5-a30d-2ce1444fad47 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:45.193157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fcf2e-5516-4ec5-a30d-2ce1444fad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:45.221814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-251fcf2e-5516-4ec5-a30d-2ce1444fad47 None None] MFA Rules not processed for user `7c423f9b97ca400ea55401fa553f58be`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:45.223050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-251fcf2e-5516-4ec5-a30d-2ce1444fad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:45.290919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1091/2170] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:45.295473 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5941be-b8b6-42fb-b4e1-f08a04bf4230 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:45.306615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5941be-b8b6-42fb-b4e1-f08a04bf4230 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:45.311574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba70092-95f8-4394-941b-c6de4461c6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:45.312301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70092-95f8-4394-941b-c6de4461c6bc admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:45.313215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70092-95f8-4394-941b-c6de4461c6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:45.313560 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70092-95f8-4394-941b-c6de4461c6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:45.314269 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba70092-95f8-4394-941b-c6de4461c6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:45.316291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba70092-95f8-4394-941b-c6de4461c6bc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:45.347854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1080/2171] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:26:45 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:45.348842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fcf2e-5516-4ec5-a30d-2ce1444fad47 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:45.360075 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fcf2e-5516-4ec5-a30d-2ce1444fad47 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:45.379440 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:45.417413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6172-ec6d-4615-8c29-167c29fa314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:45.418024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6172-ec6d-4615-8c29-167c29fa314a admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:45.418303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6172-ec6d-4615-8c29-167c29fa314a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:45.418576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6172-ec6d-4615-8c29-167c29fa314a admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:45.419202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd6172-ec6d-4615-8c29-167c29fa314a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:45.421126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd6172-ec6d-4615-8c29-167c29fa314a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:45.445599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1092/2172] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:26:45 2022] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:45.446793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba70092-95f8-4394-941b-c6de4461c6bc admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:45.457256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba70092-95f8-4394-941b-c6de4461c6bc admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:45.462221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe8fa8-b2a7-485d-a5fb-6f6d6d42a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:45.462808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe8fa8-b2a7-485d-a5fb-6f6d6d42a831 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:45.463082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe8fa8-b2a7-485d-a5fb-6f6d6d42a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:45.463386 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe8fa8-b2a7-485d-a5fb-6f6d6d42a831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:45.464285 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe8fa8-b2a7-485d-a5fb-6f6d6d42a831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:45.465859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe8fa8-b2a7-485d-a5fb-6f6d6d42a831 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:45.476209 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1081/2173] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:45.480111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6172-ec6d-4615-8c29-167c29fa314a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:45.490248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6172-ec6d-4615-8c29-167c29fa314a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:45.494789 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411fc64-874a-4f3e-978f-51626c514bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:45.495458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411fc64-874a-4f3e-978f-51626c514bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:45.495737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411fc64-874a-4f3e-978f-51626c514bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:45.496007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411fc64-874a-4f3e-978f-51626c514bd9 admin admin] PATH_INFO: `/v3/projects/a1e0e758dcea4c73bbb8183b1e5ecdac/users/513848b23d2d4d0e920038c8c25b2e32/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:45.512341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411fc64-874a-4f3e-978f-51626c514bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e0e758dcea4c73bbb8183b1e5ecdac, user_id=513848b23d2d4d0e920038c8c25b2e32, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:45.514962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411fc64-874a-4f3e-978f-51626c514bd9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:45.528595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1093/2174] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:45 2022] PUT /identity/v3/projects/a1e0e758dcea4c73bbb8183b1e5ecdac/users/513848b23d2d4d0e920038c8c25b2e32/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:45.532768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe8fa8-b2a7-485d-a5fb-6f6d6d42a831 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:45.542809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe8fa8-b2a7-485d-a5fb-6f6d6d42a831 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:45.592817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:45.600143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef3d00-8f5d-4b54-af3f-25d5b8500ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:45.600746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef3d00-8f5d-4b54-af3f-25d5b8500ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:45.601020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef3d00-8f5d-4b54-af3f-25d5b8500ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:45.601289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef3d00-8f5d-4b54-af3f-25d5b8500ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:45.601919 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef3d00-8f5d-4b54-af3f-25d5b8500ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:45.603536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef3d00-8f5d-4b54-af3f-25d5b8500ed6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:45.613629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1082/2175] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:45.617768 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411fc64-874a-4f3e-978f-51626c514bd9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:45.628167 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411fc64-874a-4f3e-978f-51626c514bd9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:45.633029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779c066-1804-418c-bc56-93439dfc471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:45.633676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779c066-1804-418c-bc56-93439dfc471d admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:45.633953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779c066-1804-418c-bc56-93439dfc471d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:45.634224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779c066-1804-418c-bc56-93439dfc471d admin admin] PATH_INFO: `/v3/projects/a1e0e758dcea4c73bbb8183b1e5ecdac/users/513848b23d2d4d0e920038c8c25b2e32/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:45.636145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779c066-1804-418c-bc56-93439dfc471d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e0e758dcea4c73bbb8183b1e5ecdac, user_id=513848b23d2d4d0e920038c8c25b2e32, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:45.638728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779c066-1804-418c-bc56-93439dfc471d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:45.648869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1094/2176] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:45 2022] PUT /identity/v3/projects/a1e0e758dcea4c73bbb8183b1e5ecdac/users/513848b23d2d4d0e920038c8c25b2e32/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:46.266824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ac5c-358a-47fa-b648-7c5aa018918b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:46.267113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ac5c-358a-47fa-b648-7c5aa018918b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:46.267458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ac5c-358a-47fa-b648-7c5aa018918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:46.295808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9e27ac5c-358a-47fa-b648-7c5aa018918b None None] MFA Rules not processed for user `513848b23d2d4d0e920038c8c25b2e32`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:46.297115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9e27ac5c-358a-47fa-b648-7c5aa018918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:46.369202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1083/2177] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:46 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:47.378898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779c066-1804-418c-bc56-93439dfc471d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:47.442089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779c066-1804-418c-bc56-93439dfc471d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:47.446649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:47.447283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:47.447583 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:47.447860 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] PATH_INFO: `/v3/users/7c423f9b97ca400ea55401fa553f58be` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:47.449255 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c423f9b97ca400ea55401fa553f58be)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:47.451166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:47.498578 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c423f9b97ca400ea55401fa553f58be'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.499242 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c423f9b97ca400ea55401fa553f58be'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.506394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c423f9b97ca400ea55401fa553f58be'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.513332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c423f9b97ca400ea55401fa553f58be'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.513962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c423f9b97ca400ea55401fa553f58be'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.524669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:47.533941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1095/2178] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:26:47 2022] DELETE /identity/v3/users/7c423f9b97ca400ea55401fa553f58be => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:47.700494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27ac5c-358a-47fa-b648-7c5aa018918b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:47.711374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27ac5c-358a-47fa-b648-7c5aa018918b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:47.768080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:47.768645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:47.768923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:47.769217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] PATH_INFO: `/v3/projects/fbfc22d0a4ee445db52120181958fa09` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:47.770411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbfc22d0a4ee445db52120181958fa09)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:47.772344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:47.818456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbfc22d0a4ee445db52120181958fa09', 'request_id': 'req-75934d5f-f155-4bed-a284-e8d6abe19d52'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.825976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbfc22d0a4ee445db52120181958fa09', 'request_id': 'req-75934d5f-f155-4bed-a284-e8d6abe19d52'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.832136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbfc22d0a4ee445db52120181958fa09', 'request_id': 'req-75934d5f-f155-4bed-a284-e8d6abe19d52'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.842833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] The token cache is being invalidate because project fbfc22d0a4ee445db52120181958fa09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:47.843117 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.843785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.845279 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1084/2179] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:47 2022] DELETE /identity/v3/projects/fbfc22d0a4ee445db52120181958fa09 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:47.849238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:47.850664 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:47.863680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb1da-a4e1-439d-82c4-2765ac86a92f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:47.919383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:47.920020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:47.920300 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:47.920576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] PATH_INFO: `/v3/users/513848b23d2d4d0e920038c8c25b2e32` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:47.921701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] RBAC: Authorizing `identity:delete_user(user_id=513848b23d2d4d0e920038c8c25b2e32)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:47.924053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:47.970023 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513848b23d2d4d0e920038c8c25b2e32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.970689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513848b23d2d4d0e920038c8c25b2e32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.978480 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513848b23d2d4d0e920038c8c25b2e32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.985512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513848b23d2d4d0e920038c8c25b2e32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:47.986172 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-575c8910-e7d9-4391-a934-88cec3b6881d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513848b23d2d4d0e920038c8c25b2e32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:48.003912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1096/2180] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:26:47 2022] DELETE /identity/v3/users/513848b23d2d4d0e920038c8c25b2e32 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:48.174531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:48.176192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:48.189680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75934d5f-f155-4bed-a284-e8d6abe19d52 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:48.194522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:48.250687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:48.251379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.251663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.251938 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] PATH_INFO: `/v3/projects/a1e0e758dcea4c73bbb8183b1e5ecdac` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.253140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e0e758dcea4c73bbb8183b1e5ecdac)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:48.255038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:48.300976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e0e758dcea4c73bbb8183b1e5ecdac', 'request_id': 'req-d898f593-de28-4d2b-a61d-4619aaf7c2b9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:48.308070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e0e758dcea4c73bbb8183b1e5ecdac', 'request_id': 'req-d898f593-de28-4d2b-a61d-4619aaf7c2b9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:48.314186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e0e758dcea4c73bbb8183b1e5ecdac', 'request_id': 'req-d898f593-de28-4d2b-a61d-4619aaf7c2b9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:48.325361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] The token cache is being invalidate because project a1e0e758dcea4c73bbb8183b1e5ecdac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:48.325648 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:48.326270 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d898f593-de28-4d2b-a61d-4619aaf7c2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:48.327766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1085/2181] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:48 2022] DELETE /identity/v3/projects/a1e0e758dcea4c73bbb8183b1e5ecdac => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:48.332794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5bcd-75be-4ce3-a633-bc1d7a2cdee4 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.333083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5bcd-75be-4ce3-a633-bc1d7a2cdee4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.333379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5bcd-75be-4ce3-a633-bc1d7a2cdee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.352467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a37d5bcd-75be-4ce3-a633-bc1d7a2cdee4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:48.353659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a37d5bcd-75be-4ce3-a633-bc1d7a2cdee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:48.411142 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1097/2182] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:48.418855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dd8bc-1bf0-4c2f-99b9-285401778676 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.419139 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dd8bc-1bf0-4c2f-99b9-285401778676 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.419443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dd8bc-1bf0-4c2f-99b9-285401778676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.440807 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a89dd8bc-1bf0-4c2f-99b9-285401778676 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:48.441991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a89dd8bc-1bf0-4c2f-99b9-285401778676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:48.450007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1086/2183] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:48.454253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d5bcd-75be-4ce3-a633-bc1d7a2cdee4 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:48.463699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d5bcd-75be-4ce3-a633-bc1d7a2cdee4 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:48.468159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692951cb-0f73-4fd4-be61-6926878c8127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:48.468751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692951cb-0f73-4fd4-be61-6926878c8127 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.469027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692951cb-0f73-4fd4-be61-6926878c8127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.469297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692951cb-0f73-4fd4-be61-6926878c8127 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.469932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692951cb-0f73-4fd4-be61-6926878c8127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:26:48.470229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692951cb-0f73-4fd4-be61-6926878c8127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:48.471852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692951cb-0f73-4fd4-be61-6926878c8127 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:48.480614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:48.484812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1098/2184] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:26:48.489234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dd8bc-1bf0-4c2f-99b9-285401778676 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:48.498359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dd8bc-1bf0-4c2f-99b9-285401778676 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:48.503533 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58cb0f-0c25-4ef0-82e1-322987944314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:48.504122 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58cb0f-0c25-4ef0-82e1-322987944314 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.504398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58cb0f-0c25-4ef0-82e1-322987944314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.504668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58cb0f-0c25-4ef0-82e1-322987944314 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.505302 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58cb0f-0c25-4ef0-82e1-322987944314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:48.507186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58cb0f-0c25-4ef0-82e1-322987944314 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:48.532504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1087/2185] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:26:48 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:48.536563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692951cb-0f73-4fd4-be61-6926878c8127 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:48.546450 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692951cb-0f73-4fd4-be61-6926878c8127 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:48.602484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354e6d9-f360-4049-8de7-92e4566c9084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:48.603012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e6d9-f360-4049-8de7-92e4566c9084 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.603378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e6d9-f360-4049-8de7-92e4566c9084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.603660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354e6d9-f360-4049-8de7-92e4566c9084 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.604286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354e6d9-f360-4049-8de7-92e4566c9084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:48.606178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354e6d9-f360-4049-8de7-92e4566c9084 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:48.627205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1099/2186] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:26:48 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:48.631376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58cb0f-0c25-4ef0-82e1-322987944314 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:48.641638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58cb0f-0c25-4ef0-82e1-322987944314 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:48.646238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bd59d-05d9-42e7-8d78-964cb31d6064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:48.646861 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bd59d-05d9-42e7-8d78-964cb31d6064 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.647138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bd59d-05d9-42e7-8d78-964cb31d6064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.647704 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bd59d-05d9-42e7-8d78-964cb31d6064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.648342 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bd59d-05d9-42e7-8d78-964cb31d6064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:48.649912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bd59d-05d9-42e7-8d78-964cb31d6064 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:48.660746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1088/2187] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:48.664483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354e6d9-f360-4049-8de7-92e4566c9084 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:48.675042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354e6d9-f360-4049-8de7-92e4566c9084 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:48.679643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8c004-ff1e-4d5b-ac0b-22628a37cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:48.680230 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c004-ff1e-4d5b-ac0b-22628a37cb9d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.680510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c004-ff1e-4d5b-ac0b-22628a37cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.680784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c004-ff1e-4d5b-ac0b-22628a37cb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.681414 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8c004-ff1e-4d5b-ac0b-22628a37cb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:48.682987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8c004-ff1e-4d5b-ac0b-22628a37cb9d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:48.693322 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1100/2188] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:48.697547 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bd59d-05d9-42e7-8d78-964cb31d6064 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:48.707615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bd59d-05d9-42e7-8d78-964cb31d6064 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:48.712179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47243bdf-2621-4cf5-bf1e-5d8031e2c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:48.712812 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47243bdf-2621-4cf5-bf1e-5d8031e2c191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.713086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47243bdf-2621-4cf5-bf1e-5d8031e2c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.713355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47243bdf-2621-4cf5-bf1e-5d8031e2c191 admin admin] PATH_INFO: `/v3/projects/06f4948d3c4f409f823e6c7ee154f8e0/users/9ef3ae8f84414db49e2d12770807aef1/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.727903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47243bdf-2621-4cf5-bf1e-5d8031e2c191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f4948d3c4f409f823e6c7ee154f8e0, user_id=9ef3ae8f84414db49e2d12770807aef1, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:48.730519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47243bdf-2621-4cf5-bf1e-5d8031e2c191 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:48.744080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1089/2189] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:48 2022] PUT /identity/v3/projects/06f4948d3c4f409f823e6c7ee154f8e0/users/9ef3ae8f84414db49e2d12770807aef1/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:48.754316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f207d36-14ce-4095-b374-a470637ad213 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.754601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f207d36-14ce-4095-b374-a470637ad213 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.754870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f207d36-14ce-4095-b374-a470637ad213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.782578 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-2f207d36-14ce-4095-b374-a470637ad213 None None] MFA Rules not processed for user `9ef3ae8f84414db49e2d12770807aef1`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:48.783842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2f207d36-14ce-4095-b374-a470637ad213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:48.846656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1101/2190] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:48.851165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47243bdf-2621-4cf5-bf1e-5d8031e2c191 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:48.890370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:48.915436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47243bdf-2621-4cf5-bf1e-5d8031e2c191 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:48.920065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61bfb2-fe98-4260-92e4-63c1648e540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:48.920674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61bfb2-fe98-4260-92e4-63c1648e540d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:48.920955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61bfb2-fe98-4260-92e4-63c1648e540d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:48.921228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61bfb2-fe98-4260-92e4-63c1648e540d admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:48.922433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61bfb2-fe98-4260-92e4-63c1648e540d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:48.924376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61bfb2-fe98-4260-92e4-63c1648e540d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:48.949863 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1090/2191] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:26:48 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:48.954437 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f207d36-14ce-4095-b374-a470637ad213 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:48.965194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f207d36-14ce-4095-b374-a470637ad213 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:49.022098 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b394f0d-21ab-4cbd-9cd9-afe8f0f16396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:49.022702 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b394f0d-21ab-4cbd-9cd9-afe8f0f16396 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:49.022982 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b394f0d-21ab-4cbd-9cd9-afe8f0f16396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:49.023257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b394f0d-21ab-4cbd-9cd9-afe8f0f16396 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:49.023918 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b394f0d-21ab-4cbd-9cd9-afe8f0f16396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:49.025829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b394f0d-21ab-4cbd-9cd9-afe8f0f16396 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:49.042712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:49.053144 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1102/2192] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:26:48 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:49.054378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61bfb2-fe98-4260-92e4-63c1648e540d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:49.065380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61bfb2-fe98-4260-92e4-63c1648e540d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:49.069937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159a15e-e84e-40ce-877f-88ca297207dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:49.070530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159a15e-e84e-40ce-877f-88ca297207dd admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:49.070808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159a15e-e84e-40ce-877f-88ca297207dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:49.071110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159a15e-e84e-40ce-877f-88ca297207dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:49.071780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159a15e-e84e-40ce-877f-88ca297207dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:49.073360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159a15e-e84e-40ce-877f-88ca297207dd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:49.084490 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1091/2193] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:49.088679 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b394f0d-21ab-4cbd-9cd9-afe8f0f16396 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:49.099135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b394f0d-21ab-4cbd-9cd9-afe8f0f16396 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:49.103782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde8a6-1ed0-43e5-9e4e-d760a26e048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:49.104428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde8a6-1ed0-43e5-9e4e-d760a26e048d admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:49.104710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde8a6-1ed0-43e5-9e4e-d760a26e048d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:49.104985 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde8a6-1ed0-43e5-9e4e-d760a26e048d admin admin] PATH_INFO: `/v3/projects/bab6ec5270b845a7a2ebf4688d3c5049/users/baa6c8defe004a33aee7519ad3f8cd55/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:49.119475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdde8a6-1ed0-43e5-9e4e-d760a26e048d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab6ec5270b845a7a2ebf4688d3c5049, user_id=baa6c8defe004a33aee7519ad3f8cd55, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:49.122130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdde8a6-1ed0-43e5-9e4e-d760a26e048d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:49.135372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1103/2194] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:49 2022] PUT /identity/v3/projects/bab6ec5270b845a7a2ebf4688d3c5049/users/baa6c8defe004a33aee7519ad3f8cd55/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:26:49.139229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159a15e-e84e-40ce-877f-88ca297207dd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:49.149437 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159a15e-e84e-40ce-877f-88ca297207dd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:49.204322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9778b23-22f5-4fb3-9eb5-61421c94cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:49.205218 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9778b23-22f5-4fb3-9eb5-61421c94cd84 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:49.205496 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9778b23-22f5-4fb3-9eb5-61421c94cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:49.205763 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9778b23-22f5-4fb3-9eb5-61421c94cd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:49.206385 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9778b23-22f5-4fb3-9eb5-61421c94cd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:49.207993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9778b23-22f5-4fb3-9eb5-61421c94cd84 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:49.217691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1092/2195] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:49.222367 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde8a6-1ed0-43e5-9e4e-d760a26e048d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:49.232562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde8a6-1ed0-43e5-9e4e-d760a26e048d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:49.237169 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d4f9f-4ecc-4429-b436-540ffe03d81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:49.237818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4f9f-4ecc-4429-b436-540ffe03d81c admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:49.238096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4f9f-4ecc-4429-b436-540ffe03d81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:49.238372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4f9f-4ecc-4429-b436-540ffe03d81c admin admin] PATH_INFO: `/v3/projects/bab6ec5270b845a7a2ebf4688d3c5049/users/baa6c8defe004a33aee7519ad3f8cd55/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:49.240294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d4f9f-4ecc-4429-b436-540ffe03d81c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab6ec5270b845a7a2ebf4688d3c5049, user_id=baa6c8defe004a33aee7519ad3f8cd55, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:49.242903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d4f9f-4ecc-4429-b436-540ffe03d81c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:49.252867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1104/2196] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:49 2022] PUT /identity/v3/projects/bab6ec5270b845a7a2ebf4688d3c5049/users/baa6c8defe004a33aee7519ad3f8cd55/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:26:49.263819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649e2db-749d-4347-b19a-98275791eaf1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:49.264104 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649e2db-749d-4347-b19a-98275791eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:49.264377 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649e2db-749d-4347-b19a-98275791eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:49.293426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5649e2db-749d-4347-b19a-98275791eaf1 None None] MFA Rules not processed for user `baa6c8defe004a33aee7519ad3f8cd55`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:49.294632 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5649e2db-749d-4347-b19a-98275791eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:49.362084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1093/2197] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:26:49.373200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d4f9f-4ecc-4429-b436-540ffe03d81c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:49.375460 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7b8d4f9f-4ecc-4429-b436-540ffe03d81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:49.432396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d4f9f-4ecc-4429-b436-540ffe03d81c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:49.436029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ca455-3f65-4a04-a870-18de7e7ab4a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:49.436627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ca455-3f65-4a04-a870-18de7e7ab4a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:49.436917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ca455-3f65-4a04-a870-18de7e7ab4a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:49.437171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ca455-3f65-4a04-a870-18de7e7ab4a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:49.446552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ca455-3f65-4a04-a870-18de7e7ab4a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:49.447987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ca455-3f65-4a04-a870-18de7e7ab4a9 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:49.457903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1105/2198] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:49.531786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649e2db-749d-4347-b19a-98275791eaf1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:49.541276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649e2db-749d-4347-b19a-98275791eaf1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:49.544827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53958f5-1c5b-4d55-993d-bee0c734c808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:49.545421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53958f5-1c5b-4d55-993d-bee0c734c808 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:49.545695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53958f5-1c5b-4d55-993d-bee0c734c808 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:49.545963 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53958f5-1c5b-4d55-993d-bee0c734c808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:49.575090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:49.603676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53958f5-1c5b-4d55-993d-bee0c734c808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:49.605089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53958f5-1c5b-4d55-993d-bee0c734c808 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:49.613848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1094/2199] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:52.318618 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ca455-3f65-4a04-a870-18de7e7ab4a9 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:52.379682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ca455-3f65-4a04-a870-18de7e7ab4a9 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:52.384156 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:52.384801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:52.385076 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:52.385347 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] PATH_INFO: `/v3/users/9ef3ae8f84414db49e2d12770807aef1` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:52.386473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef3ae8f84414db49e2d12770807aef1)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:52.388424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:52.434157 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef3ae8f84414db49e2d12770807aef1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:52.434796 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef3ae8f84414db49e2d12770807aef1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:52.443366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef3ae8f84414db49e2d12770807aef1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:52.450637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef3ae8f84414db49e2d12770807aef1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:52.451309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef3ae8f84414db49e2d12770807aef1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:52.453158 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:52.471503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1106/2200] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:26:52 2022] DELETE /identity/v3/users/9ef3ae8f84414db49e2d12770807aef1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:52.475992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103cfc9-d7d0-4a5b-ae9f-2845982a415d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:52.476463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103cfc9-d7d0-4a5b-ae9f-2845982a415d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:52.476577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103cfc9-d7d0-4a5b-ae9f-2845982a415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:52.495966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6103cfc9-d7d0-4a5b-ae9f-2845982a415d None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:52.497148 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6103cfc9-d7d0-4a5b-ae9f-2845982a415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:52.556931 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1095/2201] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:52.566814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:52.568194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:52.624827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fa480-c9da-4370-aeac-200f7aaf7a9e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:52.628438 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006034f4-e8a9-4d71-bfaa-d872a639bf98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:52.629037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006034f4-e8a9-4d71-bfaa-d872a639bf98 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:52.629316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006034f4-e8a9-4d71-bfaa-d872a639bf98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:52.629586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006034f4-e8a9-4d71-bfaa-d872a639bf98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:52.638306 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006034f4-e8a9-4d71-bfaa-d872a639bf98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:52.639859 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006034f4-e8a9-4d71-bfaa-d872a639bf98 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:52.650243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1107/2202] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:52.920473 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103cfc9-d7d0-4a5b-ae9f-2845982a415d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:52.921959 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6103cfc9-d7d0-4a5b-ae9f-2845982a415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:52.934136 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103cfc9-d7d0-4a5b-ae9f-2845982a415d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:52.938999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:52.939720 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:52.939999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:52.940278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] PATH_INFO: `/v3/projects/06f4948d3c4f409f823e6c7ee154f8e0` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:52.941416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f4948d3c4f409f823e6c7ee154f8e0)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:52.943569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:52.990531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f4948d3c4f409f823e6c7ee154f8e0', 'request_id': 'req-26e40c02-1620-424d-a65c-7941aaee793c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:52.997977 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f4948d3c4f409f823e6c7ee154f8e0', 'request_id': 'req-26e40c02-1620-424d-a65c-7941aaee793c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.003983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f4948d3c4f409f823e6c7ee154f8e0', 'request_id': 'req-26e40c02-1620-424d-a65c-7941aaee793c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.016360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] The token cache is being invalidate because project 06f4948d3c4f409f823e6c7ee154f8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:53.016649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.017287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.018754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1096/2203] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:52 2022] DELETE /identity/v3/projects/06f4948d3c4f409f823e6c7ee154f8e0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:26:53.022762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006034f4-e8a9-4d71-bfaa-d872a639bf98 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:53.032966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006034f4-e8a9-4d71-bfaa-d872a639bf98 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:53.090577 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:53.091140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:53.091472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:53.091749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] PATH_INFO: `/v3/users/baa6c8defe004a33aee7519ad3f8cd55` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:53.092897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa6c8defe004a33aee7519ad3f8cd55)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:53.094878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:53.139872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa6c8defe004a33aee7519ad3f8cd55'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.141111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa6c8defe004a33aee7519ad3f8cd55'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.148528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa6c8defe004a33aee7519ad3f8cd55'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.155593 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa6c8defe004a33aee7519ad3f8cd55'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.156218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9653830-dc3d-4e14-a79d-71a25886935a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa6c8defe004a33aee7519ad3f8cd55'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.173283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1108/2204] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:26:53 2022] DELETE /identity/v3/users/baa6c8defe004a33aee7519ad3f8cd55 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:53.441529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:53.443028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:53.458929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e40c02-1620-424d-a65c-7941aaee793c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:53.508952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:53.519887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:53.520576 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:53.520862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:53.521137 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] PATH_INFO: `/v3/projects/bab6ec5270b845a7a2ebf4688d3c5049` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:53.522287 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab6ec5270b845a7a2ebf4688d3c5049)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:53.524238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:53.569594 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab6ec5270b845a7a2ebf4688d3c5049', 'request_id': 'req-f81e7e79-250b-477a-9fcc-2e220f6c3857'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.576494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab6ec5270b845a7a2ebf4688d3c5049', 'request_id': 'req-f81e7e79-250b-477a-9fcc-2e220f6c3857'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.582125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab6ec5270b845a7a2ebf4688d3c5049', 'request_id': 'req-f81e7e79-250b-477a-9fcc-2e220f6c3857'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.592795 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] The token cache is being invalidate because project bab6ec5270b845a7a2ebf4688d3c5049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:53.593082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.593758 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f81e7e79-250b-477a-9fcc-2e220f6c3857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:53.595218 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1097/2205] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:53 2022] DELETE /identity/v3/projects/bab6ec5270b845a7a2ebf4688d3c5049 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:53.600081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf489d-22c0-4da1-a40c-503eba715010 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:53.600541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf489d-22c0-4da1-a40c-503eba715010 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:53.600677 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf489d-22c0-4da1-a40c-503eba715010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:53.609550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:53.621031 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-cdbf489d-22c0-4da1-a40c-503eba715010 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:53.622150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-cdbf489d-22c0-4da1-a40c-503eba715010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:53.680238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1109/2206] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:53.688495 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17d76c-ec5c-4071-96a6-39f130f6d40a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:53.688776 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17d76c-ec5c-4071-96a6-39f130f6d40a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:53.689064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17d76c-ec5c-4071-96a6-39f130f6d40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:53.708358 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-dd17d76c-ec5c-4071-96a6-39f130f6d40a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:53.709539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dd17d76c-ec5c-4071-96a6-39f130f6d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:53.717298 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1098/2207] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:53.721239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf489d-22c0-4da1-a40c-503eba715010 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:53.730715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf489d-22c0-4da1-a40c-503eba715010 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:53.735773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e865-c2a2-45e1-969f-26e389717844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:53.736360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e865-c2a2-45e1-969f-26e389717844 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:53.736636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e865-c2a2-45e1-969f-26e389717844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:53.736911 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e865-c2a2-45e1-969f-26e389717844 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:53.737549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e865-c2a2-45e1-969f-26e389717844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:26:53.737845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e865-c2a2-45e1-969f-26e389717844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:53.739448 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e865-c2a2-45e1-969f-26e389717844 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:53.751528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1110/2208] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:26:53.755515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17d76c-ec5c-4071-96a6-39f130f6d40a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:53.764847 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17d76c-ec5c-4071-96a6-39f130f6d40a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:53.769544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d2665-245a-4be9-91c9-169cc460c58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:53.770140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d2665-245a-4be9-91c9-169cc460c58e admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:53.770422 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d2665-245a-4be9-91c9-169cc460c58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:53.770697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d2665-245a-4be9-91c9-169cc460c58e admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:53.771368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d2665-245a-4be9-91c9-169cc460c58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:53.773248 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d2665-245a-4be9-91c9-169cc460c58e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:53.800647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1099/2209] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:26:53 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:26:53.804843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e865-c2a2-45e1-969f-26e389717844 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:53.815677 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e865-c2a2-45e1-969f-26e389717844 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:53.872307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3182d-4835-4f10-bde0-d4fd9c8ac7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:53.872865 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3182d-4835-4f10-bde0-d4fd9c8ac7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:53.873140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3182d-4835-4f10-bde0-d4fd9c8ac7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:53.873414 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3182d-4835-4f10-bde0-d4fd9c8ac7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:53.874036 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3182d-4835-4f10-bde0-d4fd9c8ac7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:53.876024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3182d-4835-4f10-bde0-d4fd9c8ac7a4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:53.896614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1111/2210] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:26:53 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:53.900705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d2665-245a-4be9-91c9-169cc460c58e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:53.911582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d2665-245a-4be9-91c9-169cc460c58e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:53.916169 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c892db-ab4b-469e-a963-f3db5cf33ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:53.916765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c892db-ab4b-469e-a963-f3db5cf33ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:53.917045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c892db-ab4b-469e-a963-f3db5cf33ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:53.917317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c892db-ab4b-469e-a963-f3db5cf33ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:53.917949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c892db-ab4b-469e-a963-f3db5cf33ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:53.919569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c892db-ab4b-469e-a963-f3db5cf33ebf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:53.929957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1100/2211] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:53.933743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3182d-4835-4f10-bde0-d4fd9c8ac7a4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:53.943470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3182d-4835-4f10-bde0-d4fd9c8ac7a4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:53.948083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5d05d-ec21-4390-ac5d-8f70592752fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:53.948666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d05d-ec21-4390-ac5d-8f70592752fc admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:53.949198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d05d-ec21-4390-ac5d-8f70592752fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:53.949465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d05d-ec21-4390-ac5d-8f70592752fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:53.950090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5d05d-ec21-4390-ac5d-8f70592752fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:53.951691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5d05d-ec21-4390-ac5d-8f70592752fc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:53.963024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1112/2212] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:53.967134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c892db-ab4b-469e-a963-f3db5cf33ebf admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:53.977680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c892db-ab4b-469e-a963-f3db5cf33ebf admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:53.982480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e919c8-f6e1-4a00-9d54-ba97cb1210b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:53.983171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e919c8-f6e1-4a00-9d54-ba97cb1210b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:53.983482 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e919c8-f6e1-4a00-9d54-ba97cb1210b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:53.983757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e919c8-f6e1-4a00-9d54-ba97cb1210b4 admin admin] PATH_INFO: `/v3/projects/b5a9cc125cf34cec8e40fe5d313a0bc9/users/5d5146cbafe84cee87ef009b0f7fa8cb/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:53.998722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e919c8-f6e1-4a00-9d54-ba97cb1210b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a9cc125cf34cec8e40fe5d313a0bc9, user_id=5d5146cbafe84cee87ef009b0f7fa8cb, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:54.001412 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e919c8-f6e1-4a00-9d54-ba97cb1210b4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:54.014380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1101/2213] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:53 2022] PUT /identity/v3/projects/b5a9cc125cf34cec8e40fe5d313a0bc9/users/5d5146cbafe84cee87ef009b0f7fa8cb/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:54.024670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cba219-4995-47a0-8f04-91e008a53bd4 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:54.024938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cba219-4995-47a0-8f04-91e008a53bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:54.025214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cba219-4995-47a0-8f04-91e008a53bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:54.055896 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-41cba219-4995-47a0-8f04-91e008a53bd4 None None] MFA Rules not processed for user `5d5146cbafe84cee87ef009b0f7fa8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:54.057092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-41cba219-4995-47a0-8f04-91e008a53bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:54.116930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:54.121109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1113/2214] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:54.125138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e919c8-f6e1-4a00-9d54-ba97cb1210b4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:54.184948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e919c8-f6e1-4a00-9d54-ba97cb1210b4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:54.189574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e0234-9a6a-4cc4-96bc-1e77857bd786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:54.190167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e0234-9a6a-4cc4-96bc-1e77857bd786 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:54.190443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e0234-9a6a-4cc4-96bc-1e77857bd786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:54.190710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e0234-9a6a-4cc4-96bc-1e77857bd786 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:54.191355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e0234-9a6a-4cc4-96bc-1e77857bd786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:54.193237 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e0234-9a6a-4cc4-96bc-1e77857bd786 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:54.219849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1102/2215] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:26:54 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:54.223993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cba219-4995-47a0-8f04-91e008a53bd4 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:54.234332 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cba219-4995-47a0-8f04-91e008a53bd4 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:54.289128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e69174-cf35-4143-aab3-e3926ae2d620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:54.289742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69174-cf35-4143-aab3-e3926ae2d620 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:54.290051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69174-cf35-4143-aab3-e3926ae2d620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:54.290330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69174-cf35-4143-aab3-e3926ae2d620 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:54.290984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e69174-cf35-4143-aab3-e3926ae2d620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:54.292949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e69174-cf35-4143-aab3-e3926ae2d620 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:54.314984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1114/2216] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:26:54 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:26:54.319134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e0234-9a6a-4cc4-96bc-1e77857bd786 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:54.326047 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:54.330192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e0234-9a6a-4cc4-96bc-1e77857bd786 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:54.336351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d868ff-d86d-4f0a-a73a-7119220c081b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:54.337120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d868ff-d86d-4f0a-a73a-7119220c081b admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:54.337602 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d868ff-d86d-4f0a-a73a-7119220c081b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:54.337925 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d868ff-d86d-4f0a-a73a-7119220c081b admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:54.338771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d868ff-d86d-4f0a-a73a-7119220c081b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:54.340414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d868ff-d86d-4f0a-a73a-7119220c081b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:54.350905 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1103/2217] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:54.355114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e69174-cf35-4143-aab3-e3926ae2d620 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:54.365564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e69174-cf35-4143-aab3-e3926ae2d620 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:54.370314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a1cc9-1bf4-49b7-90ea-ee0345cd7b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:54.370954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a1cc9-1bf4-49b7-90ea-ee0345cd7b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:54.371232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a1cc9-1bf4-49b7-90ea-ee0345cd7b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:54.371529 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a1cc9-1bf4-49b7-90ea-ee0345cd7b31 admin admin] PATH_INFO: `/v3/projects/fe66f6707f4a4a8980070f5e1772fb51/users/7640bbacc02f4d52b19e7ab27c547901/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:54.386508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a1cc9-1bf4-49b7-90ea-ee0345cd7b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe66f6707f4a4a8980070f5e1772fb51, user_id=7640bbacc02f4d52b19e7ab27c547901, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:54.389108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a1cc9-1bf4-49b7-90ea-ee0345cd7b31 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:54.401322 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1115/2218] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:54 2022] PUT /identity/v3/projects/fe66f6707f4a4a8980070f5e1772fb51/users/7640bbacc02f4d52b19e7ab27c547901/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:54.405210 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d868ff-d86d-4f0a-a73a-7119220c081b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:54.415068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d868ff-d86d-4f0a-a73a-7119220c081b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:54.471012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4339e-7f10-4fc5-b147-51096397a1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:54.471647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4339e-7f10-4fc5-b147-51096397a1bd admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:54.471926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4339e-7f10-4fc5-b147-51096397a1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:54.472200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4339e-7f10-4fc5-b147-51096397a1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:54.472835 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4339e-7f10-4fc5-b147-51096397a1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:54.474414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4339e-7f10-4fc5-b147-51096397a1bd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:54.484584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1104/2219] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:54.488751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a1cc9-1bf4-49b7-90ea-ee0345cd7b31 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:54.499261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a1cc9-1bf4-49b7-90ea-ee0345cd7b31 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:54.504603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9a823-94ee-4523-9d47-79a4bac64e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:54.505285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9a823-94ee-4523-9d47-79a4bac64e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:54.505565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9a823-94ee-4523-9d47-79a4bac64e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:54.505839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9a823-94ee-4523-9d47-79a4bac64e6c admin admin] PATH_INFO: `/v3/projects/fe66f6707f4a4a8980070f5e1772fb51/users/7640bbacc02f4d52b19e7ab27c547901/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:54.507806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9a823-94ee-4523-9d47-79a4bac64e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe66f6707f4a4a8980070f5e1772fb51, user_id=7640bbacc02f4d52b19e7ab27c547901, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:54.510498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9a823-94ee-4523-9d47-79a4bac64e6c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:54.522002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1116/2220] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:54 2022] PUT /identity/v3/projects/fe66f6707f4a4a8980070f5e1772fb51/users/7640bbacc02f4d52b19e7ab27c547901/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:54.533434 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a1937-4597-4d54-9b28-408987db220c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:54.533970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a1937-4597-4d54-9b28-408987db220c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:54.534126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a1937-4597-4d54-9b28-408987db220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:54.565825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4f9a1937-4597-4d54-9b28-408987db220c None None] MFA Rules not processed for user `7640bbacc02f4d52b19e7ab27c547901`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:54.567091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4f9a1937-4597-4d54-9b28-408987db220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:54.639072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1105/2221] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:54.651456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9a823-94ee-4523-9d47-79a4bac64e6c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:54.653256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8bd9a823-94ee-4523-9d47-79a4bac64e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:54.712049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9a823-94ee-4523-9d47-79a4bac64e6c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:54.715709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447f88b-c271-4dd3-b9b3-4b7e75ca07ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:54.716314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447f88b-c271-4dd3-b9b3-4b7e75ca07ae service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:54.716595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447f88b-c271-4dd3-b9b3-4b7e75ca07ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:54.716872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447f88b-c271-4dd3-b9b3-4b7e75ca07ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:54.726266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447f88b-c271-4dd3-b9b3-4b7e75ca07ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:54.727713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447f88b-c271-4dd3-b9b3-4b7e75ca07ae service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:54.737618 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1117/2222] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:55.037882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a1937-4597-4d54-9b28-408987db220c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:55.047031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a1937-4597-4d54-9b28-408987db220c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:55.051796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d617c-0973-440a-a389-7778dea45dd4 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640bbacc02f4d52b19e7ab27c547901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe66f6707f4a4a8980070f5e1772fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:55.052424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d617c-0973-440a-a389-7778dea45dd4 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:55.052709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d617c-0973-440a-a389-7778dea45dd4 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:55.053638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d617c-0973-440a-a389-7778dea45dd4 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:55.054307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d617c-0973-440a-a389-7778dea45dd4 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:26:55.054617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d617c-0973-440a-a389-7778dea45dd4 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:55.056250 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d617c-0973-440a-a389-7778dea45dd4 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:55.068433 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1106/2223] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:26:55.072361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447f88b-c271-4dd3-b9b3-4b7e75ca07ae service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:55.082311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447f88b-c271-4dd3-b9b3-4b7e75ca07ae service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:55.086921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835ecaa-8adc-4604-9f54-e41ce43694aa tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640bbacc02f4d52b19e7ab27c547901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe66f6707f4a4a8980070f5e1772fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:55.087545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835ecaa-8adc-4604-9f54-e41ce43694aa tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:55.087824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835ecaa-8adc-4604-9f54-e41ce43694aa tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:55.088097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835ecaa-8adc-4604-9f54-e41ce43694aa tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:55.088748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835ecaa-8adc-4604-9f54-e41ce43694aa tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:55.090626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835ecaa-8adc-4604-9f54-e41ce43694aa tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:55.116922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1118/2224] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:26:55 2022] POST /identity/v3/projects => generated 353 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:55.120838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d617c-0973-440a-a389-7778dea45dd4 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:55.130596 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d617c-0973-440a-a389-7778dea45dd4 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:55.192505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234824c-022b-4c7e-80de-903233bdace9 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640bbacc02f4d52b19e7ab27c547901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe66f6707f4a4a8980070f5e1772fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:55.193284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234824c-022b-4c7e-80de-903233bdace9 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:55.193559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234824c-022b-4c7e-80de-903233bdace9 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:55.193869 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234824c-022b-4c7e-80de-903233bdace9 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:55.194542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234824c-022b-4c7e-80de-903233bdace9 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:26:55.194849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234824c-022b-4c7e-80de-903233bdace9 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:55.196470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234824c-022b-4c7e-80de-903233bdace9 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:55.199565 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:55.210536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1107/2225] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:26:55.248262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835ecaa-8adc-4604-9f54-e41ce43694aa tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:55.260269 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835ecaa-8adc-4604-9f54-e41ce43694aa tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:55.268323 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7640bbacc02f4d52b19e7ab27c547901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe66f6707f4a4a8980070f5e1772fb51', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:55.269017 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:55.269472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:55.269720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] PATH_INFO: `/v3/projects/e27f1cc995f24b1bb425f268f0b97936` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:55.271034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e27f1cc995f24b1bb425f268f0b97936)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:55.273082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:55.305812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:55.327560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27f1cc995f24b1bb425f268f0b97936', 'request_id': 'req-3eec4063-a1d5-410f-99c7-94829726ad94'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:55.334786 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27f1cc995f24b1bb425f268f0b97936', 'request_id': 'req-3eec4063-a1d5-410f-99c7-94829726ad94'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:55.341761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27f1cc995f24b1bb425f268f0b97936', 'request_id': 'req-3eec4063-a1d5-410f-99c7-94829726ad94'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:55.354162 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] The token cache is being invalidate because project e27f1cc995f24b1bb425f268f0b97936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:55.354455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:55.355108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3eec4063-a1d5-410f-99c7-94829726ad94 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:55.356648 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1119/2226] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:55 2022] DELETE /identity/v3/projects/e27f1cc995f24b1bb425f268f0b97936 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:55.573698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234824c-022b-4c7e-80de-903233bdace9 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:55.575847 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4234824c-022b-4c7e-80de-903233bdace9 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:55.640139 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234824c-022b-4c7e-80de-903233bdace9 tempest-VolumeQuotaClassesTest-1040427660 tempest-VolumeQuotaClassesTest-1040427660-project-admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:55.695898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:55.696527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:55.696802 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:55.697071 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] PATH_INFO: `/v3/users/5d5146cbafe84cee87ef009b0f7fa8cb` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:55.698206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5146cbafe84cee87ef009b0f7fa8cb)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:55.700414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:55.746007 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5146cbafe84cee87ef009b0f7fa8cb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:55.753574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5146cbafe84cee87ef009b0f7fa8cb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:55.760370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5146cbafe84cee87ef009b0f7fa8cb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:55.773426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5146cbafe84cee87ef009b0f7fa8cb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:55.774044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5146cbafe84cee87ef009b0f7fa8cb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:55.779797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1108/2227] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:26:55 2022] DELETE /identity/v3/users/5d5146cbafe84cee87ef009b0f7fa8cb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:55.784263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a76313-13ed-4b4a-838c-c3603a4a84f1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:55.784718 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a76313-13ed-4b4a-838c-c3603a4a84f1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:55.784811 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a76313-13ed-4b4a-838c-c3603a4a84f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:55.803960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-40a76313-13ed-4b4a-838c-c3603a4a84f1 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:55.805201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-40a76313-13ed-4b4a-838c-c3603a4a84f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:55.864247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1120/2228] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:55.874521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:55.875973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:55.903504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:55.936351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86192d7-2a1c-4872-acd0-32219f6e52bf admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:55.940646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868da01-e20a-4a5a-853e-99789e2c774d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:55.941252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868da01-e20a-4a5a-853e-99789e2c774d service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:55.941534 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868da01-e20a-4a5a-853e-99789e2c774d service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:55.941816 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868da01-e20a-4a5a-853e-99789e2c774d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:55.951519 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868da01-e20a-4a5a-853e-99789e2c774d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:55.952929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868da01-e20a-4a5a-853e-99789e2c774d service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:55.962276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1109/2229] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:56.229325 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a76313-13ed-4b4a-838c-c3603a4a84f1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:56.230810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-40a76313-13ed-4b4a-838c-c3603a4a84f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:56.243423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a76313-13ed-4b4a-838c-c3603a4a84f1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:56.248059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:56.248699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:56.249005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:56.249288 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] PATH_INFO: `/v3/projects/b5a9cc125cf34cec8e40fe5d313a0bc9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:56.250421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a9cc125cf34cec8e40fe5d313a0bc9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:56.252454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:56.299901 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a9cc125cf34cec8e40fe5d313a0bc9', 'request_id': 'req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.306311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a9cc125cf34cec8e40fe5d313a0bc9', 'request_id': 'req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.313257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a9cc125cf34cec8e40fe5d313a0bc9', 'request_id': 'req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.331032 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] The token cache is being invalidate because project b5a9cc125cf34cec8e40fe5d313a0bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:56.331356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.332020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.333552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1121/2230] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:56 2022] DELETE /identity/v3/projects/b5a9cc125cf34cec8e40fe5d313a0bc9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:56.337725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868da01-e20a-4a5a-853e-99789e2c774d service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:56.348354 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868da01-e20a-4a5a-853e-99789e2c774d service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:56.411498 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:56.412141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:56.412421 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:56.412691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] PATH_INFO: `/v3/users/7640bbacc02f4d52b19e7ab27c547901` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:56.413820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7640bbacc02f4d52b19e7ab27c547901)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:56.415783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:56.466427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7640bbacc02f4d52b19e7ab27c547901'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.475369 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7640bbacc02f4d52b19e7ab27c547901'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.483308 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7640bbacc02f4d52b19e7ab27c547901'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.497003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7640bbacc02f4d52b19e7ab27c547901'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.497681 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-250ac425-cffc-453b-8289-cdbcd9f5afdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7640bbacc02f4d52b19e7ab27c547901'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.503840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1110/2231] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:26:56 2022] DELETE /identity/v3/users/7640bbacc02f4d52b19e7ab27c547901 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:56.787891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:56.789370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:56.803960 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08de7ab-5e9f-432b-a210-0b3cbfb0d53e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:56.858287 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:56.884629 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:56.885370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:56.885732 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:56.886077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] PATH_INFO: `/v3/projects/fe66f6707f4a4a8980070f5e1772fb51` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:56.887316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe66f6707f4a4a8980070f5e1772fb51)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:56.889412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:56.937330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe66f6707f4a4a8980070f5e1772fb51', 'request_id': 'req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.943166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe66f6707f4a4a8980070f5e1772fb51', 'request_id': 'req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.949562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe66f6707f4a4a8980070f5e1772fb51', 'request_id': 'req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.962129 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] The token cache is being invalidate because project fe66f6707f4a4a8980070f5e1772fb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:26:56.962421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.963064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6cd689d2-09f3-4636-94d7-3ca45f8dafaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:26:56.964563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1122/2232] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:26:56 2022] DELETE /identity/v3/projects/fe66f6707f4a4a8980070f5e1772fb51 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:26:56.969477 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb190b5-e79a-498e-ae26-e9eb586a6868 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:56.970446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb190b5-e79a-498e-ae26-e9eb586a6868 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:56.970574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb190b5-e79a-498e-ae26-e9eb586a6868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:56.991700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-bfb190b5-e79a-498e-ae26-e9eb586a6868 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:56.992889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bfb190b5-e79a-498e-ae26-e9eb586a6868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:57.035096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:57.060409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1111/2233] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:57.068251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9b2e-d82b-46b7-8716-aaf9eb5ec07f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.068525 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9b2e-d82b-46b7-8716-aaf9eb5ec07f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.068800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9b2e-d82b-46b7-8716-aaf9eb5ec07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.088493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-254b9b2e-d82b-46b7-8716-aaf9eb5ec07f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:57.089666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-254b9b2e-d82b-46b7-8716-aaf9eb5ec07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:57.097988 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1123/2234] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:57.102395 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb190b5-e79a-498e-ae26-e9eb586a6868 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.112996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb190b5-e79a-498e-ae26-e9eb586a6868 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.118017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac66f2-c318-4965-aada-28512672bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.118613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac66f2-c318-4965-aada-28512672bae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.118891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac66f2-c318-4965-aada-28512672bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.119160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac66f2-c318-4965-aada-28512672bae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.119857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac66f2-c318-4965-aada-28512672bae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:26:57.120157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac66f2-c318-4965-aada-28512672bae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.121732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac66f2-c318-4965-aada-28512672bae9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.134856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1112/2235] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:26:57.139155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9b2e-d82b-46b7-8716-aaf9eb5ec07f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.148871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9b2e-d82b-46b7-8716-aaf9eb5ec07f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.153512 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4fd77-6fb6-44f8-a594-518cca50eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.154125 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4fd77-6fb6-44f8-a594-518cca50eb51 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.154402 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4fd77-6fb6-44f8-a594-518cca50eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.154764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4fd77-6fb6-44f8-a594-518cca50eb51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.155475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4fd77-6fb6-44f8-a594-518cca50eb51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.157491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4fd77-6fb6-44f8-a594-518cca50eb51 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.188817 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1124/2236] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:26:57 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:26:57.190037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac66f2-c318-4965-aada-28512672bae9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.200481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac66f2-c318-4965-aada-28512672bae9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.258045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794190-c183-45dd-8fa3-f92e765a4e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.258650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794190-c183-45dd-8fa3-f92e765a4e26 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.258928 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794190-c183-45dd-8fa3-f92e765a4e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.259200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794190-c183-45dd-8fa3-f92e765a4e26 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.259892 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794190-c183-45dd-8fa3-f92e765a4e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.261841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794190-c183-45dd-8fa3-f92e765a4e26 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.282022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1113/2237] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:26:57 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:26:57.286379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4fd77-6fb6-44f8-a594-518cca50eb51 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.296604 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4fd77-6fb6-44f8-a594-518cca50eb51 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.301703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39262ea-45d4-4f73-8c4a-3e8fc0a59c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.302297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39262ea-45d4-4f73-8c4a-3e8fc0a59c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.302576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39262ea-45d4-4f73-8c4a-3e8fc0a59c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.302848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39262ea-45d4-4f73-8c4a-3e8fc0a59c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.303524 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39262ea-45d4-4f73-8c4a-3e8fc0a59c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.305097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39262ea-45d4-4f73-8c4a-3e8fc0a59c71 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.315801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1125/2238] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:57.319683 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794190-c183-45dd-8fa3-f92e765a4e26 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.329795 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794190-c183-45dd-8fa3-f92e765a4e26 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.334392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae596071-a0a6-475d-8270-468ba1eedcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.334983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae596071-a0a6-475d-8270-468ba1eedcee admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.335263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae596071-a0a6-475d-8270-468ba1eedcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.335567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae596071-a0a6-475d-8270-468ba1eedcee admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.336204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae596071-a0a6-475d-8270-468ba1eedcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.337794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae596071-a0a6-475d-8270-468ba1eedcee admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.348372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1114/2239] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:57.352328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39262ea-45d4-4f73-8c4a-3e8fc0a59c71 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.362543 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39262ea-45d4-4f73-8c4a-3e8fc0a59c71 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.367102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627c6d0-8275-4360-b83e-26b47fee1a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.367783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627c6d0-8275-4360-b83e-26b47fee1a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.368096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627c6d0-8275-4360-b83e-26b47fee1a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.368369 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627c6d0-8275-4360-b83e-26b47fee1a7d admin admin] PATH_INFO: `/v3/projects/b81d0fd20c7140ed89d4b49184479c63/users/49061366fcb34e678597b7d2a30708f5/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.383166 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627c6d0-8275-4360-b83e-26b47fee1a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81d0fd20c7140ed89d4b49184479c63, user_id=49061366fcb34e678597b7d2a30708f5, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.385835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627c6d0-8275-4360-b83e-26b47fee1a7d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.398252 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1126/2240] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:57 2022] PUT /identity/v3/projects/b81d0fd20c7140ed89d4b49184479c63/users/49061366fcb34e678597b7d2a30708f5/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:26:57.409343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c719-1776-4cd7-b736-f8e21fa2271e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.409631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c719-1776-4cd7-b736-f8e21fa2271e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.409909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c719-1776-4cd7-b736-f8e21fa2271e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.437947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-83c3c719-1776-4cd7-b736-f8e21fa2271e None None] MFA Rules not processed for user `49061366fcb34e678597b7d2a30708f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:57.439783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-83c3c719-1776-4cd7-b736-f8e21fa2271e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:57.502641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1115/2241] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:57.507105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627c6d0-8275-4360-b83e-26b47fee1a7d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.567187 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627c6d0-8275-4360-b83e-26b47fee1a7d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.571785 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d827e49-d3f5-4328-a1bb-bb99ecd3a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.572384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d827e49-d3f5-4328-a1bb-bb99ecd3a231 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.572663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d827e49-d3f5-4328-a1bb-bb99ecd3a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.572934 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d827e49-d3f5-4328-a1bb-bb99ecd3a231 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.573558 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d827e49-d3f5-4328-a1bb-bb99ecd3a231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.575732 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d827e49-d3f5-4328-a1bb-bb99ecd3a231 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.586468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:57.603386 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1127/2242] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:26:57 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:57.607378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c719-1776-4cd7-b736-f8e21fa2271e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.618973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c719-1776-4cd7-b736-f8e21fa2271e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.659852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:57.681194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267f65-fe42-4af1-97ae-61434b36a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.681807 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267f65-fe42-4af1-97ae-61434b36a610 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.682083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267f65-fe42-4af1-97ae-61434b36a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.682350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267f65-fe42-4af1-97ae-61434b36a610 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.682992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1267f65-fe42-4af1-97ae-61434b36a610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.684929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1267f65-fe42-4af1-97ae-61434b36a610 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.705385 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1116/2243] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:26:57 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:26:57.709370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d827e49-d3f5-4328-a1bb-bb99ecd3a231 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.719745 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d827e49-d3f5-4328-a1bb-bb99ecd3a231 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.724973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f72924-6cda-4813-a931-aa851e3999ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.725576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f72924-6cda-4813-a931-aa851e3999ea admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.725856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f72924-6cda-4813-a931-aa851e3999ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.726132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f72924-6cda-4813-a931-aa851e3999ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.726778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f72924-6cda-4813-a931-aa851e3999ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.728434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f72924-6cda-4813-a931-aa851e3999ea admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.739458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1128/2244] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:57.743526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267f65-fe42-4af1-97ae-61434b36a610 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.753314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267f65-fe42-4af1-97ae-61434b36a610 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.757834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d136-a8f7-455d-ae49-6afe9d7da7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.758469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d136-a8f7-455d-ae49-6afe9d7da7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.758743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d136-a8f7-455d-ae49-6afe9d7da7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.759013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d136-a8f7-455d-ae49-6afe9d7da7a6 admin admin] PATH_INFO: `/v3/projects/27fad88b3f7b4fdd8bcc6208df223cef/users/d8334892a6db4cb38ce582b05b4a4042/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.773264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6d136-a8f7-455d-ae49-6afe9d7da7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fad88b3f7b4fdd8bcc6208df223cef, user_id=d8334892a6db4cb38ce582b05b4a4042, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.776091 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6d136-a8f7-455d-ae49-6afe9d7da7a6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.788870 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1117/2245] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:57 2022] PUT /identity/v3/projects/27fad88b3f7b4fdd8bcc6208df223cef/users/d8334892a6db4cb38ce582b05b4a4042/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:26:57.792706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f72924-6cda-4813-a931-aa851e3999ea admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.803596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f72924-6cda-4813-a931-aa851e3999ea admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.858503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7600bab-35c4-4ce3-ac51-c340726b776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.859026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7600bab-35c4-4ce3-ac51-c340726b776d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.859328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7600bab-35c4-4ce3-ac51-c340726b776d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.859601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7600bab-35c4-4ce3-ac51-c340726b776d admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.860226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7600bab-35c4-4ce3-ac51-c340726b776d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.862412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7600bab-35c4-4ce3-ac51-c340726b776d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.872823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1129/2246] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:26:57.876908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d136-a8f7-455d-ae49-6afe9d7da7a6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:57.886799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d136-a8f7-455d-ae49-6afe9d7da7a6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:57.891379 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ff82-f75f-4418-8a74-f6bd43934146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:57.892532 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ff82-f75f-4418-8a74-f6bd43934146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.892805 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ff82-f75f-4418-8a74-f6bd43934146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.893069 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ff82-f75f-4418-8a74-f6bd43934146 admin admin] PATH_INFO: `/v3/projects/27fad88b3f7b4fdd8bcc6208df223cef/users/d8334892a6db4cb38ce582b05b4a4042/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.894936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6ff82-f75f-4418-8a74-f6bd43934146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fad88b3f7b4fdd8bcc6208df223cef, user_id=d8334892a6db4cb38ce582b05b4a4042, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:57.897613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6ff82-f75f-4418-8a74-f6bd43934146 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:57.908746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1118/2247] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:26:57 2022] PUT /identity/v3/projects/27fad88b3f7b4fdd8bcc6208df223cef/users/d8334892a6db4cb38ce582b05b4a4042/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:26:57.918926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4906a58-e7ca-4094-8cc8-8133af19394c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:57.919216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4906a58-e7ca-4094-8cc8-8133af19394c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:57.919532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4906a58-e7ca-4094-8cc8-8133af19394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:57.948553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b4906a58-e7ca-4094-8cc8-8133af19394c None None] MFA Rules not processed for user `d8334892a6db4cb38ce582b05b4a4042`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:26:57.950035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b4906a58-e7ca-4094-8cc8-8133af19394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:58.021581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1130/2248] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:26:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:26:58.032024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ff82-f75f-4418-8a74-f6bd43934146 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:58.034365 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a4e6ff82-f75f-4418-8a74-f6bd43934146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:58.098851 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ff82-f75f-4418-8a74-f6bd43934146 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:58.102552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d13ba4-2b79-4c85-804d-52634a09fa4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:58.103160 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13ba4-2b79-4c85-804d-52634a09fa4f service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:58.103474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13ba4-2b79-4c85-804d-52634a09fa4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:58.103751 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13ba4-2b79-4c85-804d-52634a09fa4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:58.113118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d13ba4-2b79-4c85-804d-52634a09fa4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:58.114775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d13ba4-2b79-4c85-804d-52634a09fa4f service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:58.124193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1119/2249] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:26:58.173568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4906a58-e7ca-4094-8cc8-8133af19394c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:26:58.175769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b4906a58-e7ca-4094-8cc8-8133af19394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:26:58.188258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4906a58-e7ca-4094-8cc8-8133af19394c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:26:58.191881 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96cd58-303d-4f69-af52-e6e0ff665d08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:26:58.192483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96cd58-303d-4f69-af52-e6e0ff665d08 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:26:58.192764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96cd58-303d-4f69-af52-e6e0ff665d08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:26:58.193040 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96cd58-303d-4f69-af52-e6e0ff665d08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:26:58.249758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96cd58-303d-4f69-af52-e6e0ff665d08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:26:58.251213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96cd58-303d-4f69-af52-e6e0ff665d08 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:26:58.255759 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:26:58.260527 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1131/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:26:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:01.517440 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d13ba4-2b79-4c85-804d-52634a09fa4f service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:01.578554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d13ba4-2b79-4c85-804d-52634a09fa4f service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:01.583824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:01.584467 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:01.584743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:01.585041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] PATH_INFO: `/v3/users/49061366fcb34e678597b7d2a30708f5` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:01.586162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=49061366fcb34e678597b7d2a30708f5)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:01.588119 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:01.627404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:01.636038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49061366fcb34e678597b7d2a30708f5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:01.646141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49061366fcb34e678597b7d2a30708f5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:01.654507 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49061366fcb34e678597b7d2a30708f5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:01.667625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49061366fcb34e678597b7d2a30708f5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:01.668252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49061366fcb34e678597b7d2a30708f5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:01.674702 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1120/2251] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:01 2022] DELETE /identity/v3/users/49061366fcb34e678597b7d2a30708f5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:01.679256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e22dcf-b769-440c-9f08-38ffe9ff02dc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:01.679801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e22dcf-b769-440c-9f08-38ffe9ff02dc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:01.679914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e22dcf-b769-440c-9f08-38ffe9ff02dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:01.699357 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c8e22dcf-b769-440c-9f08-38ffe9ff02dc None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:01.700533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c8e22dcf-b769-440c-9f08-38ffe9ff02dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:01.759539 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1132/2252] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:01.769188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:01.770595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:01.828060 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c178-255a-4f79-87db-69b4bac06abc admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:01.831634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b391f1c-8515-4dc4-9f62-b005da221c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:01.832231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b391f1c-8515-4dc4-9f62-b005da221c55 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:01.832509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b391f1c-8515-4dc4-9f62-b005da221c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:01.832780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b391f1c-8515-4dc4-9f62-b005da221c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:01.841449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b391f1c-8515-4dc4-9f62-b005da221c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:01.842852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b391f1c-8515-4dc4-9f62-b005da221c55 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:01.852286 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1121/2253] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:02.115324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e22dcf-b769-440c-9f08-38ffe9ff02dc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:02.116761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c8e22dcf-b769-440c-9f08-38ffe9ff02dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:02.131083 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e22dcf-b769-440c-9f08-38ffe9ff02dc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:02.136564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:02.137799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:02.138102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:02.138475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] PATH_INFO: `/v3/projects/b81d0fd20c7140ed89d4b49184479c63` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:02.139617 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81d0fd20c7140ed89d4b49184479c63)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:02.141499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:02.190089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81d0fd20c7140ed89d4b49184479c63', 'request_id': 'req-0d3b8979-463c-4161-8196-ec7d9a28de32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.195560 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81d0fd20c7140ed89d4b49184479c63', 'request_id': 'req-0d3b8979-463c-4161-8196-ec7d9a28de32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.202020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81d0fd20c7140ed89d4b49184479c63', 'request_id': 'req-0d3b8979-463c-4161-8196-ec7d9a28de32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.214201 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] The token cache is being invalidate because project b81d0fd20c7140ed89d4b49184479c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:02.214506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.215150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.216866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1133/2254] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:02 2022] DELETE /identity/v3/projects/b81d0fd20c7140ed89d4b49184479c63 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:02.221775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b391f1c-8515-4dc4-9f62-b005da221c55 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:02.232053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b391f1c-8515-4dc4-9f62-b005da221c55 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:02.289304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:02.290325 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:02.290611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:02.290888 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] PATH_INFO: `/v3/users/d8334892a6db4cb38ce582b05b4a4042` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:02.292041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8334892a6db4cb38ce582b05b4a4042)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:02.294810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:02.342906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8334892a6db4cb38ce582b05b4a4042'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.350889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8334892a6db4cb38ce582b05b4a4042'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.353406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:02.359447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8334892a6db4cb38ce582b05b4a4042'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.373333 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8334892a6db4cb38ce582b05b4a4042'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.373969 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f83a9a6-3baa-49be-bf6f-016025af6c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8334892a6db4cb38ce582b05b4a4042'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.380046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1122/2255] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:02 2022] DELETE /identity/v3/users/d8334892a6db4cb38ce582b05b4a4042 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:02.670035 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:02.671615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:02.686982 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b8979-463c-4161-8196-ec7d9a28de32 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:02.760602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:02.761272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:02.761554 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:02.761832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] PATH_INFO: `/v3/projects/27fad88b3f7b4fdd8bcc6208df223cef` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:02.762950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=27fad88b3f7b4fdd8bcc6208df223cef)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:02.764871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:02.803349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:02.823077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27fad88b3f7b4fdd8bcc6208df223cef', 'request_id': 'req-3736da81-5591-4975-b067-0a9252bbb00c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.829898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27fad88b3f7b4fdd8bcc6208df223cef', 'request_id': 'req-3736da81-5591-4975-b067-0a9252bbb00c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.836972 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27fad88b3f7b4fdd8bcc6208df223cef', 'request_id': 'req-3736da81-5591-4975-b067-0a9252bbb00c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.849701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] The token cache is being invalidate because project 27fad88b3f7b4fdd8bcc6208df223cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:02.850012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.850630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3736da81-5591-4975-b067-0a9252bbb00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:02.852372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1134/2256] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:02 2022] DELETE /identity/v3/projects/27fad88b3f7b4fdd8bcc6208df223cef => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:02.856993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60655-d370-44f2-848f-75cd7aae4b5f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:02.857448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60655-d370-44f2-848f-75cd7aae4b5f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:02.857565 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60655-d370-44f2-848f-75cd7aae4b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:02.878253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b3d60655-d370-44f2-848f-75cd7aae4b5f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:02.879471 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b3d60655-d370-44f2-848f-75cd7aae4b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:02.939100 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1123/2257] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:02.946847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514feef-eb9c-40e9-8c92-68c40acc2c1f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:02.947133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514feef-eb9c-40e9-8c92-68c40acc2c1f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:02.947436 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514feef-eb9c-40e9-8c92-68c40acc2c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:02.967764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d514feef-eb9c-40e9-8c92-68c40acc2c1f None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:02.968969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d514feef-eb9c-40e9-8c92-68c40acc2c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:02.977010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1135/2258] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:02.981236 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60655-d370-44f2-848f-75cd7aae4b5f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:02.991039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60655-d370-44f2-848f-75cd7aae4b5f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:02.995758 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a8b80-cf48-4d49-a943-4d7cc41ebc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:02.996362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a8b80-cf48-4d49-a943-4d7cc41ebc11 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:02.996833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a8b80-cf48-4d49-a943-4d7cc41ebc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:02.996968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a8b80-cf48-4d49-a943-4d7cc41ebc11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:02.997586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a8b80-cf48-4d49-a943-4d7cc41ebc11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:27:02.997894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a8b80-cf48-4d49-a943-4d7cc41ebc11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:02.999514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a8b80-cf48-4d49-a943-4d7cc41ebc11 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.012357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1124/2259] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:27:03.018441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514feef-eb9c-40e9-8c92-68c40acc2c1f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.027931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514feef-eb9c-40e9-8c92-68c40acc2c1f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.032598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bc623-778e-4c84-9d71-8b6b3738ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.033226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bc623-778e-4c84-9d71-8b6b3738ea6f admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.034085 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bc623-778e-4c84-9d71-8b6b3738ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.034085 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bc623-778e-4c84-9d71-8b6b3738ea6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.034497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bc623-778e-4c84-9d71-8b6b3738ea6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.036485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bc623-778e-4c84-9d71-8b6b3738ea6f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.067765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1136/2260] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:03 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:27:03.071936 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a8b80-cf48-4d49-a943-4d7cc41ebc11 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.083144 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a8b80-cf48-4d49-a943-4d7cc41ebc11 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.139675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ec1e4-d3f8-4c77-aeed-790c2c5ec114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.140297 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ec1e4-d3f8-4c77-aeed-790c2c5ec114 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.140559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ec1e4-d3f8-4c77-aeed-790c2c5ec114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.140835 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ec1e4-d3f8-4c77-aeed-790c2c5ec114 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.141460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ec1e4-d3f8-4c77-aeed-790c2c5ec114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.143929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ec1e4-d3f8-4c77-aeed-790c2c5ec114 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.168317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1125/2261] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:03 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:27:03.169694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bc623-778e-4c84-9d71-8b6b3738ea6f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.180421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bc623-778e-4c84-9d71-8b6b3738ea6f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.185038 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c1bd3-d619-4824-bc25-d7c770137647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.185666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c1bd3-d619-4824-bc25-d7c770137647 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.185944 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c1bd3-d619-4824-bc25-d7c770137647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.186217 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c1bd3-d619-4824-bc25-d7c770137647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.186851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c1bd3-d619-4824-bc25-d7c770137647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.189176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c1bd3-d619-4824-bc25-d7c770137647 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.199262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1137/2262] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:03.203177 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ec1e4-d3f8-4c77-aeed-790c2c5ec114 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.213403 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ec1e4-d3f8-4c77-aeed-790c2c5ec114 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.218147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5134cc6-f50a-461a-9c70-caabce1e127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.218744 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5134cc6-f50a-461a-9c70-caabce1e127d admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.219033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5134cc6-f50a-461a-9c70-caabce1e127d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.219359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5134cc6-f50a-461a-9c70-caabce1e127d admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.220001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5134cc6-f50a-461a-9c70-caabce1e127d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.221594 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5134cc6-f50a-461a-9c70-caabce1e127d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.233902 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1126/2263] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:27:03.238521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c1bd3-d619-4824-bc25-d7c770137647 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.248551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c1bd3-d619-4824-bc25-d7c770137647 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.253834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892c385-3440-477b-9066-c4a24836610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.254486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892c385-3440-477b-9066-c4a24836610e admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.254766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892c385-3440-477b-9066-c4a24836610e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.255041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892c385-3440-477b-9066-c4a24836610e admin admin] PATH_INFO: `/v3/projects/a48779de00954742a698332b3ff7603c/users/d583ca2da05640b48efd2b6f48879f4b/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.280721 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892c385-3440-477b-9066-c4a24836610e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48779de00954742a698332b3ff7603c, user_id=d583ca2da05640b48efd2b6f48879f4b, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.283477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892c385-3440-477b-9066-c4a24836610e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.298954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1138/2264] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:03 2022] PUT /identity/v3/projects/a48779de00954742a698332b3ff7603c/users/d583ca2da05640b48efd2b6f48879f4b/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:03.309859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4325dce-8970-4764-aa14-72d7e457ca27 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.310150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4325dce-8970-4764-aa14-72d7e457ca27 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.310451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4325dce-8970-4764-aa14-72d7e457ca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.339095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d4325dce-8970-4764-aa14-72d7e457ca27 None None] MFA Rules not processed for user `d583ca2da05640b48efd2b6f48879f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:03.340329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d4325dce-8970-4764-aa14-72d7e457ca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:03.371419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:03.409658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1127/2265] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:03.414235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892c385-3440-477b-9066-c4a24836610e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.481632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892c385-3440-477b-9066-c4a24836610e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.487148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b2fcc-0de8-49fb-9e69-e7cbd82cc50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.487800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2fcc-0de8-49fb-9e69-e7cbd82cc50f admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.488077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2fcc-0de8-49fb-9e69-e7cbd82cc50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.488372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2fcc-0de8-49fb-9e69-e7cbd82cc50f admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.489000 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b2fcc-0de8-49fb-9e69-e7cbd82cc50f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.490875 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b2fcc-0de8-49fb-9e69-e7cbd82cc50f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.519516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1139/2266] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:03 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:03.523449 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4325dce-8970-4764-aa14-72d7e457ca27 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.535168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4325dce-8970-4764-aa14-72d7e457ca27 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.592892 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfb5b0-5c64-472a-b3c8-bc60c9d5d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.593511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfb5b0-5c64-472a-b3c8-bc60c9d5d216 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.593790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfb5b0-5c64-472a-b3c8-bc60c9d5d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.594066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfb5b0-5c64-472a-b3c8-bc60c9d5d216 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.595225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfb5b0-5c64-472a-b3c8-bc60c9d5d216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.597153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfb5b0-5c64-472a-b3c8-bc60c9d5d216 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.618894 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1128/2267] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:03 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:03.622865 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b2fcc-0de8-49fb-9e69-e7cbd82cc50f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.633016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b2fcc-0de8-49fb-9e69-e7cbd82cc50f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.637551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d2adc-4ecc-4c66-b0e9-4ecd68a16b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.638160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d2adc-4ecc-4c66-b0e9-4ecd68a16b7b admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.638422 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d2adc-4ecc-4c66-b0e9-4ecd68a16b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.638693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d2adc-4ecc-4c66-b0e9-4ecd68a16b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.639353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d2adc-4ecc-4c66-b0e9-4ecd68a16b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.640914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d2adc-4ecc-4c66-b0e9-4ecd68a16b7b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.651147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1140/2268] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:03.655022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfb5b0-5c64-472a-b3c8-bc60c9d5d216 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.665412 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfb5b0-5c64-472a-b3c8-bc60c9d5d216 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.670028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327791ce-176c-4aa8-acb2-9ebca1857ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.670669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327791ce-176c-4aa8-acb2-9ebca1857ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.670997 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327791ce-176c-4aa8-acb2-9ebca1857ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.671215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327791ce-176c-4aa8-acb2-9ebca1857ecb admin admin] PATH_INFO: `/v3/projects/49a0440e34184b0b899d2423b9d074b5/users/9a151855441042f0b22fe713b1b10bf8/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.686164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327791ce-176c-4aa8-acb2-9ebca1857ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a0440e34184b0b899d2423b9d074b5, user_id=9a151855441042f0b22fe713b1b10bf8, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.688841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327791ce-176c-4aa8-acb2-9ebca1857ecb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.701399 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1129/2269] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:03 2022] PUT /identity/v3/projects/49a0440e34184b0b899d2423b9d074b5/users/9a151855441042f0b22fe713b1b10bf8/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:03.705264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d2adc-4ecc-4c66-b0e9-4ecd68a16b7b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.715195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d2adc-4ecc-4c66-b0e9-4ecd68a16b7b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.735102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:03.772892 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1cec3-28dc-42de-b3ac-6cf12a4a8a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.773494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1cec3-28dc-42de-b3ac-6cf12a4a8a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.773778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1cec3-28dc-42de-b3ac-6cf12a4a8a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.774051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1cec3-28dc-42de-b3ac-6cf12a4a8a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.774685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1cec3-28dc-42de-b3ac-6cf12a4a8a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.776302 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1cec3-28dc-42de-b3ac-6cf12a4a8a12 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.786496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1141/2270] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:27:03.790733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327791ce-176c-4aa8-acb2-9ebca1857ecb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.801477 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327791ce-176c-4aa8-acb2-9ebca1857ecb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:03.806110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486a0a0-59c5-4771-851f-82e9df9e7790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:03.806762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486a0a0-59c5-4771-851f-82e9df9e7790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.807040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486a0a0-59c5-4771-851f-82e9df9e7790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.807351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486a0a0-59c5-4771-851f-82e9df9e7790 admin admin] PATH_INFO: `/v3/projects/49a0440e34184b0b899d2423b9d074b5/users/9a151855441042f0b22fe713b1b10bf8/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.809275 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486a0a0-59c5-4771-851f-82e9df9e7790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a0440e34184b0b899d2423b9d074b5, user_id=9a151855441042f0b22fe713b1b10bf8, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:03.811938 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486a0a0-59c5-4771-851f-82e9df9e7790 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:03.822769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1130/2271] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:03 2022] PUT /identity/v3/projects/49a0440e34184b0b899d2423b9d074b5/users/9a151855441042f0b22fe713b1b10bf8/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:03.833160 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fd3fd-2156-4da6-84d0-3a7d93ce47d2 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:03.833478 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fd3fd-2156-4da6-84d0-3a7d93ce47d2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:03.833757 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fd3fd-2156-4da6-84d0-3a7d93ce47d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:03.861628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ca0fd3fd-2156-4da6-84d0-3a7d93ce47d2 None None] MFA Rules not processed for user `9a151855441042f0b22fe713b1b10bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:03.862820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ca0fd3fd-2156-4da6-84d0-3a7d93ce47d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:03.931226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1142/2272] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:03.942062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486a0a0-59c5-4771-851f-82e9df9e7790 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:03.943783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b486a0a0-59c5-4771-851f-82e9df9e7790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:04.000041 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486a0a0-59c5-4771-851f-82e9df9e7790 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:04.003671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b9d07-64e0-4edb-94cb-90bc4d71a31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:04.004265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b9d07-64e0-4edb-94cb-90bc4d71a31d service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:04.004540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b9d07-64e0-4edb-94cb-90bc4d71a31d service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:04.004810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b9d07-64e0-4edb-94cb-90bc4d71a31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:04.013502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b9d07-64e0-4edb-94cb-90bc4d71a31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:04.014900 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b9d07-64e0-4edb-94cb-90bc4d71a31d service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:04.024604 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1131/2273] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:04.160986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fd3fd-2156-4da6-84d0-3a7d93ce47d2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:04.224804 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fd3fd-2156-4da6-84d0-3a7d93ce47d2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:04.229262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:04.229917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:04.230194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:04.230470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] PATH_INFO: `/v3/users/d583ca2da05640b48efd2b6f48879f4b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:04.231605 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d583ca2da05640b48efd2b6f48879f4b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:04.233513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:04.294205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd583ca2da05640b48efd2b6f48879f4b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:04.295408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd583ca2da05640b48efd2b6f48879f4b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:04.297235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:04.304473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd583ca2da05640b48efd2b6f48879f4b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:04.315858 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd583ca2da05640b48efd2b6f48879f4b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:04.317106 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd583ca2da05640b48efd2b6f48879f4b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:04.336592 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1143/2274] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:04 2022] DELETE /identity/v3/users/d583ca2da05640b48efd2b6f48879f4b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:04.341069 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daab9e-65d3-4eed-a1c4-4fff0bd4a498 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:04.341356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daab9e-65d3-4eed-a1c4-4fff0bd4a498 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:04.341628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daab9e-65d3-4eed-a1c4-4fff0bd4a498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:04.360998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a3daab9e-65d3-4eed-a1c4-4fff0bd4a498 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:04.362311 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a3daab9e-65d3-4eed-a1c4-4fff0bd4a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:04.383527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:04.424380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1132/2275] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:04.434578 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:04.436338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:04.497325 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ad1d-f630-4601-87e4-3b2a624b1395 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:04.501469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8bf15-8d81-4c45-b658-8b5f703821b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:04.502084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8bf15-8d81-4c45-b658-8b5f703821b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:04.502364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8bf15-8d81-4c45-b658-8b5f703821b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:04.502639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8bf15-8d81-4c45-b658-8b5f703821b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:04.511867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8bf15-8d81-4c45-b658-8b5f703821b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:04.513286 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8bf15-8d81-4c45-b658-8b5f703821b3 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:04.523867 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1144/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:04.805028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daab9e-65d3-4eed-a1c4-4fff0bd4a498 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:04.806639 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a3daab9e-65d3-4eed-a1c4-4fff0bd4a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:04.820262 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daab9e-65d3-4eed-a1c4-4fff0bd4a498 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:04.826272 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:04.827769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:04.828584 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:04.828879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] PATH_INFO: `/v3/projects/a48779de00954742a698332b3ff7603c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:04.830162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48779de00954742a698332b3ff7603c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:04.832860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:04.891554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48779de00954742a698332b3ff7603c', 'request_id': 'req-54fdf92b-a730-45dd-9815-70ecdf1da172'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:04.899301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48779de00954742a698332b3ff7603c', 'request_id': 'req-54fdf92b-a730-45dd-9815-70ecdf1da172'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:04.905530 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48779de00954742a698332b3ff7603c', 'request_id': 'req-54fdf92b-a730-45dd-9815-70ecdf1da172'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:04.918062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] The token cache is being invalidate because project a48779de00954742a698332b3ff7603c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:04.918360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:04.919017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:04.920552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1133/2277] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:04 2022] DELETE /identity/v3/projects/a48779de00954742a698332b3ff7603c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:04.930389 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8bf15-8d81-4c45-b658-8b5f703821b3 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:04.940413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8bf15-8d81-4c45-b658-8b5f703821b3 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:04.996340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:04.996969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:04.997245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:04.997516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] PATH_INFO: `/v3/users/9a151855441042f0b22fe713b1b10bf8` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:04.998623 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a151855441042f0b22fe713b1b10bf8)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:05.000686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:05.045511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a151855441042f0b22fe713b1b10bf8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:05.046210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a151855441042f0b22fe713b1b10bf8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:05.056241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a151855441042f0b22fe713b1b10bf8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:05.063134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a151855441042f0b22fe713b1b10bf8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:05.063889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c7b9b87-637c-4dff-b50f-51bda4a2d84c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a151855441042f0b22fe713b1b10bf8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:05.068993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:05.083358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1145/2278] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:04 2022] DELETE /identity/v3/users/9a151855441042f0b22fe713b1b10bf8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:27:05.362567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:05.364168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:05.382933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdf92b-a730-45dd-9815-70ecdf1da172 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:05.445216 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:05.445972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:05.446334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:05.446607 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] PATH_INFO: `/v3/projects/49a0440e34184b0b899d2423b9d074b5` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:05.447780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a0440e34184b0b899d2423b9d074b5)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:05.449975 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:05.496622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a0440e34184b0b899d2423b9d074b5', 'request_id': 'req-a9cda609-3ca1-4780-bbde-0249e8a466a0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:05.499080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:05.504272 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a0440e34184b0b899d2423b9d074b5', 'request_id': 'req-a9cda609-3ca1-4780-bbde-0249e8a466a0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:05.511063 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a0440e34184b0b899d2423b9d074b5', 'request_id': 'req-a9cda609-3ca1-4780-bbde-0249e8a466a0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:05.523543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] The token cache is being invalidate because project 49a0440e34184b0b899d2423b9d074b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:05.523976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:05.524623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9cda609-3ca1-4780-bbde-0249e8a466a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:05.526093 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1134/2279] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:05 2022] DELETE /identity/v3/projects/49a0440e34184b0b899d2423b9d074b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:05.531082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8f049-0abb-4e16-8a45-f3b77ca65493 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:05.531409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8f049-0abb-4e16-8a45-f3b77ca65493 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:05.531682 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8f049-0abb-4e16-8a45-f3b77ca65493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:05.552434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-afa8f049-0abb-4e16-8a45-f3b77ca65493 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:05.553706 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-afa8f049-0abb-4e16-8a45-f3b77ca65493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:05.614006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1146/2280] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:05.621852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a5b6-d297-4fff-ac0d-dc7de3af03a8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:05.622140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a5b6-d297-4fff-ac0d-dc7de3af03a8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:05.622450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a5b6-d297-4fff-ac0d-dc7de3af03a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:05.643463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7798a5b6-d297-4fff-ac0d-dc7de3af03a8 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:05.644668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7798a5b6-d297-4fff-ac0d-dc7de3af03a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:05.652527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1135/2281] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:05.656626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8f049-0abb-4e16-8a45-f3b77ca65493 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:05.667494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8f049-0abb-4e16-8a45-f3b77ca65493 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:05.672237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c5a7-0ba3-435c-ba9c-12ea12ac7302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:05.672828 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c5a7-0ba3-435c-ba9c-12ea12ac7302 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:05.673106 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c5a7-0ba3-435c-ba9c-12ea12ac7302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:05.673377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c5a7-0ba3-435c-ba9c-12ea12ac7302 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:05.674017 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887c5a7-0ba3-435c-ba9c-12ea12ac7302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:27:05.674318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887c5a7-0ba3-435c-ba9c-12ea12ac7302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:05.675938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887c5a7-0ba3-435c-ba9c-12ea12ac7302 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:05.687419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1147/2282] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:27:05.691600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798a5b6-d297-4fff-ac0d-dc7de3af03a8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:05.700868 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798a5b6-d297-4fff-ac0d-dc7de3af03a8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:05.706268 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde94e2c-54ee-42a6-821c-09c612533d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:05.706857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94e2c-54ee-42a6-821c-09c612533d18 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:05.707131 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94e2c-54ee-42a6-821c-09c612533d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:05.707446 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94e2c-54ee-42a6-821c-09c612533d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:05.708079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde94e2c-54ee-42a6-821c-09c612533d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:05.709942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde94e2c-54ee-42a6-821c-09c612533d18 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:05.736119 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1136/2283] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:05 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:05.740245 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c5a7-0ba3-435c-ba9c-12ea12ac7302 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:05.749888 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c5a7-0ba3-435c-ba9c-12ea12ac7302 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:05.808408 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17860dd-f311-46d9-950a-9c0da2aa783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:05.808909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17860dd-f311-46d9-950a-9c0da2aa783e admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:05.809191 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17860dd-f311-46d9-950a-9c0da2aa783e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:05.809490 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17860dd-f311-46d9-950a-9c0da2aa783e admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:05.810130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17860dd-f311-46d9-950a-9c0da2aa783e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:05.812084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17860dd-f311-46d9-950a-9c0da2aa783e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:05.835191 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1148/2284] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:05 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:05.839470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde94e2c-54ee-42a6-821c-09c612533d18 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:05.850175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde94e2c-54ee-42a6-821c-09c612533d18 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:05.854823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39b8b8-c7b8-480a-a5d5-d81bf5974bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:05.855458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39b8b8-c7b8-480a-a5d5-d81bf5974bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:05.855743 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39b8b8-c7b8-480a-a5d5-d81bf5974bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:05.856017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39b8b8-c7b8-480a-a5d5-d81bf5974bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:05.856687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39b8b8-c7b8-480a-a5d5-d81bf5974bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:05.858290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39b8b8-c7b8-480a-a5d5-d81bf5974bc7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:05.870075 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1137/2285] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:05.874159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17860dd-f311-46d9-950a-9c0da2aa783e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:05.884940 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17860dd-f311-46d9-950a-9c0da2aa783e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:05.889607 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b258590-b1db-45c8-a61d-3475ba2981f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:05.890202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b258590-b1db-45c8-a61d-3475ba2981f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:05.890485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b258590-b1db-45c8-a61d-3475ba2981f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:05.890760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b258590-b1db-45c8-a61d-3475ba2981f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:05.891499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b258590-b1db-45c8-a61d-3475ba2981f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:05.893645 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b258590-b1db-45c8-a61d-3475ba2981f8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:05.907932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1149/2286] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:05.909339 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39b8b8-c7b8-480a-a5d5-d81bf5974bc7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:05.919941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39b8b8-c7b8-480a-a5d5-d81bf5974bc7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:05.924668 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43c301-5b4e-4f73-b0bc-59240af0e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:05.925317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43c301-5b4e-4f73-b0bc-59240af0e58f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:05.925644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43c301-5b4e-4f73-b0bc-59240af0e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:05.925920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43c301-5b4e-4f73-b0bc-59240af0e58f admin admin] PATH_INFO: `/v3/projects/4268a894d05e48aea23d1c006da52c96/users/1c41bda4e26543459ef395677c9d16d3/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:05.941152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43c301-5b4e-4f73-b0bc-59240af0e58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4268a894d05e48aea23d1c006da52c96, user_id=1c41bda4e26543459ef395677c9d16d3, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:05.943868 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43c301-5b4e-4f73-b0bc-59240af0e58f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:05.957820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1138/2287] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:05 2022] PUT /identity/v3/projects/4268a894d05e48aea23d1c006da52c96/users/1c41bda4e26543459ef395677c9d16d3/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:06.023818 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568446ff-ba7a-4e5b-8b2e-e53de46e2a7d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:06.024333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568446ff-ba7a-4e5b-8b2e-e53de46e2a7d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:06.024553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568446ff-ba7a-4e5b-8b2e-e53de46e2a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:06.058511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-568446ff-ba7a-4e5b-8b2e-e53de46e2a7d None None] MFA Rules not processed for user `1c41bda4e26543459ef395677c9d16d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:06.060037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-568446ff-ba7a-4e5b-8b2e-e53de46e2a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:06.106121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:06.132198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1150/2288] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:06.143453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43c301-5b4e-4f73-b0bc-59240af0e58f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:06.145182 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ba43c301-5b4e-4f73-b0bc-59240af0e58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:06.205677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43c301-5b4e-4f73-b0bc-59240af0e58f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:06.209411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c8769-7bf3-4a7a-8370-94741200d28f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:06.210013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8769-7bf3-4a7a-8370-94741200d28f service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:06.210289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8769-7bf3-4a7a-8370-94741200d28f service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:06.210559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8769-7bf3-4a7a-8370-94741200d28f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:06.220844 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c8769-7bf3-4a7a-8370-94741200d28f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:06.222268 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c8769-7bf3-4a7a-8370-94741200d28f service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:06.231350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1139/2289] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:09.793449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568446ff-ba7a-4e5b-8b2e-e53de46e2a7d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:09.795296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-568446ff-ba7a-4e5b-8b2e-e53de46e2a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:09.912105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568446ff-ba7a-4e5b-8b2e-e53de46e2a7d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:09.917666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f74df1-0630-4cc0-af31-904fc3dc11da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:09.918293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f74df1-0630-4cc0-af31-904fc3dc11da service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:09.918576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f74df1-0630-4cc0-af31-904fc3dc11da service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:09.918851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f74df1-0630-4cc0-af31-904fc3dc11da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:09.920740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-23f74df1-0630-4cc0-af31-904fc3dc11da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:09.933592 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f74df1-0630-4cc0-af31-904fc3dc11da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:09.934870 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f74df1-0630-4cc0-af31-904fc3dc11da service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:09.964711 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1151/2290] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:11.421813 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c8769-7bf3-4a7a-8370-94741200d28f service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:11.424324 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d96c8769-7bf3-4a7a-8370-94741200d28f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:11.489921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c8769-7bf3-4a7a-8370-94741200d28f service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:11.493557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe43c-f17a-43c6-b3a5-f7d9ea45fee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:11.494165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe43c-f17a-43c6-b3a5-f7d9ea45fee9 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:11.494445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe43c-f17a-43c6-b3a5-f7d9ea45fee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:11.494716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe43c-f17a-43c6-b3a5-f7d9ea45fee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:11.496628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cdafe43c-f17a-43c6-b3a5-f7d9ea45fee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:11.531004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:11.560277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafe43c-f17a-43c6-b3a5-f7d9ea45fee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:11.561691 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafe43c-f17a-43c6-b3a5-f7d9ea45fee9 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:11.571096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1140/2291] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:15.586206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f74df1-0630-4cc0-af31-904fc3dc11da service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:15.587625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-23f74df1-0630-4cc0-af31-904fc3dc11da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:15.599308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f74df1-0630-4cc0-af31-904fc3dc11da service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:15.603001 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea010190-8d22-4ac3-a71a-45af2e374c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:15.603636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea010190-8d22-4ac3-a71a-45af2e374c7a service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:15.603914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea010190-8d22-4ac3-a71a-45af2e374c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:15.604184 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea010190-8d22-4ac3-a71a-45af2e374c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:15.605937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ea010190-8d22-4ac3-a71a-45af2e374c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:15.671460 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea010190-8d22-4ac3-a71a-45af2e374c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:15.672882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea010190-8d22-4ac3-a71a-45af2e374c7a service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:15.683233 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1152/2292] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:16.406660 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe43c-f17a-43c6-b3a5-f7d9ea45fee9 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:16.418548 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe43c-f17a-43c6-b3a5-f7d9ea45fee9 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:16.426039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:16.427231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:16.427803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:16.428271 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] PATH_INFO: `/v3/users/1c41bda4e26543459ef395677c9d16d3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:16.429711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c41bda4e26543459ef395677c9d16d3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:16.432525 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:16.484564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c41bda4e26543459ef395677c9d16d3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:16.494150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c41bda4e26543459ef395677c9d16d3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:16.505448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c41bda4e26543459ef395677c9d16d3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:16.518931 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c41bda4e26543459ef395677c9d16d3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:16.520537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c41bda4e26543459ef395677c9d16d3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:16.527124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1141/2293] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:16 2022] DELETE /identity/v3/users/1c41bda4e26543459ef395677c9d16d3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:16.531700 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5c86-9fbb-464d-be47-67f88eb5f761 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:16.531984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5c86-9fbb-464d-be47-67f88eb5f761 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:16.532257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5c86-9fbb-464d-be47-67f88eb5f761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:16.557724 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b08d5c86-9fbb-464d-be47-67f88eb5f761 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:16.558964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b08d5c86-9fbb-464d-be47-67f88eb5f761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:16.630624 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1153/2294] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:16.640828 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:16.642538 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:16.713439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc715-6955-4521-9a2f-32134adbb271 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:16.718165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f7ae-c527-499f-aaaa-57ac8f98d516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:16.718786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f7ae-c527-499f-aaaa-57ac8f98d516 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:16.719113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f7ae-c527-499f-aaaa-57ac8f98d516 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:16.719427 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f7ae-c527-499f-aaaa-57ac8f98d516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:16.729323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f7ae-c527-499f-aaaa-57ac8f98d516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:16.730757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f7ae-c527-499f-aaaa-57ac8f98d516 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:16.741169 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1142/2295] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:17.184642 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5c86-9fbb-464d-be47-67f88eb5f761 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:17.186238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b08d5c86-9fbb-464d-be47-67f88eb5f761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:17.193385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:17.200703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5c86-9fbb-464d-be47-67f88eb5f761 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:17.207363 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:17.208866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:17.209342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:17.209801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] PATH_INFO: `/v3/projects/4268a894d05e48aea23d1c006da52c96` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:17.211241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4268a894d05e48aea23d1c006da52c96)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:17.213688 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:17.286637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4268a894d05e48aea23d1c006da52c96', 'request_id': 'req-e2b3a959-cbe3-436f-8de5-b6de22d405ca'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:17.296050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4268a894d05e48aea23d1c006da52c96', 'request_id': 'req-e2b3a959-cbe3-436f-8de5-b6de22d405ca'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:17.303844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4268a894d05e48aea23d1c006da52c96', 'request_id': 'req-e2b3a959-cbe3-436f-8de5-b6de22d405ca'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:17.320241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] The token cache is being invalidate because project 4268a894d05e48aea23d1c006da52c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:17.320634 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:17.321956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:17.324031 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1154/2296] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:17 2022] DELETE /identity/v3/projects/4268a894d05e48aea23d1c006da52c96 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:19.149387 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f7ae-c527-499f-aaaa-57ac8f98d516 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:19.150860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3161f7ae-c527-499f-aaaa-57ac8f98d516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:19.202283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:19.203766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:19.206053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:19.230362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f7ae-c527-499f-aaaa-57ac8f98d516 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:19.271466 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3a959-cbe3-436f-8de5-b6de22d405ca admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:19.276274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:19.276897 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:19.277715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:19.277715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] PATH_INFO: `/v3/users/54d2608c7c8e4d7581fd9a944d8f18e0` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:19.279496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d2608c7c8e4d7581fd9a944d8f18e0)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:19.281603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:19.292754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576f75d-2be1-488a-8124-10c8923fc3a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa89e84c708f44c299c728284e33fabf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:19.297613 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576f75d-2be1-488a-8124-10c8923fc3a4 service placement] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:19.299291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576f75d-2be1-488a-8124-10c8923fc3a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:19.300862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576f75d-2be1-488a-8124-10c8923fc3a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:19.307078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e576f75d-2be1-488a-8124-10c8923fc3a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:19.323078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576f75d-2be1-488a-8124-10c8923fc3a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:19.325032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576f75d-2be1-488a-8124-10c8923fc3a4 service placement] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:19.336652 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d2608c7c8e4d7581fd9a944d8f18e0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:19.337383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d2608c7c8e4d7581fd9a944d8f18e0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:19.339995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1143/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:27:19.345703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d2608c7c8e4d7581fd9a944d8f18e0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:19.353950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d2608c7c8e4d7581fd9a944d8f18e0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:19.356756 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2da8ed28-4b51-4d25-b24b-c2ade4b56274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d2608c7c8e4d7581fd9a944d8f18e0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:19.385569 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1155/2298] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:19 2022] DELETE /identity/v3/users/54d2608c7c8e4d7581fd9a944d8f18e0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:27:19.559228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576f75d-2be1-488a-8124-10c8923fc3a4 service placement] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:19.571435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576f75d-2be1-488a-8124-10c8923fc3a4 service placement] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:19.628924 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:19.629578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:19.629859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:19.630130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] PATH_INFO: `/v3/projects/f8d0aa624c7e49f1a9d9e5473bac4547` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:19.631240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d0aa624c7e49f1a9d9e5473bac4547)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:19.633192 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:19.678533 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d0aa624c7e49f1a9d9e5473bac4547', 'request_id': 'req-9605e17b-92db-4b64-a05a-314408fee623'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:19.685641 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d0aa624c7e49f1a9d9e5473bac4547', 'request_id': 'req-9605e17b-92db-4b64-a05a-314408fee623'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:19.691057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d0aa624c7e49f1a9d9e5473bac4547', 'request_id': 'req-9605e17b-92db-4b64-a05a-314408fee623'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:19.702045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] The token cache is being invalidate because project f8d0aa624c7e49f1a9d9e5473bac4547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:19.702328 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:19.702945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9605e17b-92db-4b64-a05a-314408fee623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:19.704444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1144/2299] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:19 2022] DELETE /identity/v3/projects/f8d0aa624c7e49f1a9d9e5473bac4547 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:19.709435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333807d6-7a01-4aa3-babb-fee3b4ad847e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:19.709693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333807d6-7a01-4aa3-babb-fee3b4ad847e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:19.709969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333807d6-7a01-4aa3-babb-fee3b4ad847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:19.718481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:19.731012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-333807d6-7a01-4aa3-babb-fee3b4ad847e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:19.732259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-333807d6-7a01-4aa3-babb-fee3b4ad847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:19.789966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1156/2300] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:19.797622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13884936-f4ee-4ef1-b18b-9f226450111e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:19.797901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13884936-f4ee-4ef1-b18b-9f226450111e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:19.798172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13884936-f4ee-4ef1-b18b-9f226450111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:19.819662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-13884936-f4ee-4ef1-b18b-9f226450111e None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:19.820859 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-13884936-f4ee-4ef1-b18b-9f226450111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:19.828930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1145/2301] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:19.832973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333807d6-7a01-4aa3-babb-fee3b4ad847e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:19.842418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333807d6-7a01-4aa3-babb-fee3b4ad847e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:19.846908 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1a153-2705-47dd-b03b-ca31d2e9f8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:19.847545 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1a153-2705-47dd-b03b-ca31d2e9f8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:19.847824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1a153-2705-47dd-b03b-ca31d2e9f8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:19.848599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1a153-2705-47dd-b03b-ca31d2e9f8a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:19.849241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1a153-2705-47dd-b03b-ca31d2e9f8a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:27:19.849539 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1a153-2705-47dd-b03b-ca31d2e9f8a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:19.851121 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1a153-2705-47dd-b03b-ca31d2e9f8a1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:19.862615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1157/2302] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:27:19.867804 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13884936-f4ee-4ef1-b18b-9f226450111e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:19.873671 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:19.877272 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13884936-f4ee-4ef1-b18b-9f226450111e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:19.882824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba781b-868c-46b1-a041-ccd937ce690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:19.883643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba781b-868c-46b1-a041-ccd937ce690d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:19.884085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba781b-868c-46b1-a041-ccd937ce690d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:19.884415 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba781b-868c-46b1-a041-ccd937ce690d admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:19.885204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba781b-868c-46b1-a041-ccd937ce690d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:19.887083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba781b-868c-46b1-a041-ccd937ce690d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:19.913044 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1146/2303] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:19 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:27:19.917052 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1a153-2705-47dd-b03b-ca31d2e9f8a1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:19.927737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1a153-2705-47dd-b03b-ca31d2e9f8a1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:19.983113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b184cd-99df-4a50-8d01-f4345efbbfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:19.983671 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b184cd-99df-4a50-8d01-f4345efbbfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:19.983949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b184cd-99df-4a50-8d01-f4345efbbfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:19.984220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b184cd-99df-4a50-8d01-f4345efbbfa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:19.984851 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b184cd-99df-4a50-8d01-f4345efbbfa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:19.986740 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b184cd-99df-4a50-8d01-f4345efbbfa0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.009327 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1158/2304] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:19 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:27:20.013411 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba781b-868c-46b1-a041-ccd937ce690d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:20.023564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba781b-868c-46b1-a041-ccd937ce690d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:20.028168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c00244-c48d-4813-b86e-fcb57e5958b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:20.028766 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c00244-c48d-4813-b86e-fcb57e5958b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.029046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c00244-c48d-4813-b86e-fcb57e5958b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.029320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c00244-c48d-4813-b86e-fcb57e5958b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.029954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c00244-c48d-4813-b86e-fcb57e5958b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:20.031561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c00244-c48d-4813-b86e-fcb57e5958b0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.041723 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1147/2305] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:27:20.045365 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b184cd-99df-4a50-8d01-f4345efbbfa0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:20.056416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b184cd-99df-4a50-8d01-f4345efbbfa0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:20.061725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3cfee-7e9e-4547-b15e-efd2f2beaa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:20.062329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3cfee-7e9e-4547-b15e-efd2f2beaa73 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.062610 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3cfee-7e9e-4547-b15e-efd2f2beaa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.062880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3cfee-7e9e-4547-b15e-efd2f2beaa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.063549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3cfee-7e9e-4547-b15e-efd2f2beaa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:20.065124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3cfee-7e9e-4547-b15e-efd2f2beaa73 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.076020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1159/2306] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:20.080219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c00244-c48d-4813-b86e-fcb57e5958b0 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:20.091084 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c00244-c48d-4813-b86e-fcb57e5958b0 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:20.096178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd714ab2-e34d-46d1-93c8-7d07b4b691f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:20.096827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714ab2-e34d-46d1-93c8-7d07b4b691f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.097135 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714ab2-e34d-46d1-93c8-7d07b4b691f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.097413 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714ab2-e34d-46d1-93c8-7d07b4b691f5 admin admin] PATH_INFO: `/v3/projects/000df3b56c294094aa0f1248ae9c1cd5/users/2a479f4df29847bb8a381815bc306d9b/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.112903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd714ab2-e34d-46d1-93c8-7d07b4b691f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000df3b56c294094aa0f1248ae9c1cd5, user_id=2a479f4df29847bb8a381815bc306d9b, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:20.115550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd714ab2-e34d-46d1-93c8-7d07b4b691f5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.129065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1148/2307] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:20 2022] PUT /identity/v3/projects/000df3b56c294094aa0f1248ae9c1cd5/users/2a479f4df29847bb8a381815bc306d9b/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:20.140610 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e960c-0aa3-410d-846f-e9172e0c4bac None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.140895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e960c-0aa3-410d-846f-e9172e0c4bac None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.141167 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e960c-0aa3-410d-846f-e9172e0c4bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.169610 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-eb2e960c-0aa3-410d-846f-e9172e0c4bac None None] MFA Rules not processed for user `2a479f4df29847bb8a381815bc306d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:20.170819 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-eb2e960c-0aa3-410d-846f-e9172e0c4bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:20.232266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:20.240128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1160/2308] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:20.247897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd714ab2-e34d-46d1-93c8-7d07b4b691f5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:20.309546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd714ab2-e34d-46d1-93c8-7d07b4b691f5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:20.314504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd58b2-672a-4117-95b6-0acfd1959670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:20.315098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd58b2-672a-4117-95b6-0acfd1959670 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.315409 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd58b2-672a-4117-95b6-0acfd1959670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.315680 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd58b2-672a-4117-95b6-0acfd1959670 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.316299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd58b2-672a-4117-95b6-0acfd1959670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:20.318204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd58b2-672a-4117-95b6-0acfd1959670 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.343817 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1149/2309] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:20 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:20.347855 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e960c-0aa3-410d-846f-e9172e0c4bac None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:20.359187 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e960c-0aa3-410d-846f-e9172e0c4bac None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:20.415830 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04eb95-91e2-43d1-b04f-fc2d52ca3121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:20.416451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04eb95-91e2-43d1-b04f-fc2d52ca3121 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.416728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04eb95-91e2-43d1-b04f-fc2d52ca3121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.417000 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04eb95-91e2-43d1-b04f-fc2d52ca3121 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.417635 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04eb95-91e2-43d1-b04f-fc2d52ca3121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:20.419565 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04eb95-91e2-43d1-b04f-fc2d52ca3121 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.440380 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1161/2310] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:20 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:27:20.444820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd58b2-672a-4117-95b6-0acfd1959670 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:20.455140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd58b2-672a-4117-95b6-0acfd1959670 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:20.460374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064df665-6af5-4fc0-b563-6393c5187617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:20.460966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064df665-6af5-4fc0-b563-6393c5187617 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.461243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064df665-6af5-4fc0-b563-6393c5187617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.461515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064df665-6af5-4fc0-b563-6393c5187617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.462148 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064df665-6af5-4fc0-b563-6393c5187617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:20.463762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064df665-6af5-4fc0-b563-6393c5187617 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.474014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1150/2311] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:20.478060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04eb95-91e2-43d1-b04f-fc2d52ca3121 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:20.487788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04eb95-91e2-43d1-b04f-fc2d52ca3121 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:20.492285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1c856-7144-4314-a541-ae4a62c6822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:20.492924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c856-7144-4314-a541-ae4a62c6822f admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.493203 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c856-7144-4314-a541-ae4a62c6822f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.493476 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1c856-7144-4314-a541-ae4a62c6822f admin admin] PATH_INFO: `/v3/projects/3776a3a3ea18437e9d7ebc73059809d9/users/55e55a51fd074a9cb90d2c6a60af46cf/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.508205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1c856-7144-4314-a541-ae4a62c6822f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3776a3a3ea18437e9d7ebc73059809d9, user_id=55e55a51fd074a9cb90d2c6a60af46cf, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:20.510820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1c856-7144-4314-a541-ae4a62c6822f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.523715 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1162/2312] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:20 2022] PUT /identity/v3/projects/3776a3a3ea18437e9d7ebc73059809d9/users/55e55a51fd074a9cb90d2c6a60af46cf/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:27:20.527569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064df665-6af5-4fc0-b563-6393c5187617 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:20.537376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064df665-6af5-4fc0-b563-6393c5187617 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:20.592050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac145-6583-4904-918a-b3dc83abbbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:20.592644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac145-6583-4904-918a-b3dc83abbbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.592920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac145-6583-4904-918a-b3dc83abbbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.593187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac145-6583-4904-918a-b3dc83abbbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.593810 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ac145-6583-4904-918a-b3dc83abbbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:20.595413 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ac145-6583-4904-918a-b3dc83abbbc3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.605107 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1151/2313] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:20.609225 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1c856-7144-4314-a541-ae4a62c6822f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:20.619619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1c856-7144-4314-a541-ae4a62c6822f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:20.624134 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6ffba-2de9-4a1b-925f-cd6b9e16da50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:20.624772 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6ffba-2de9-4a1b-925f-cd6b9e16da50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.625050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6ffba-2de9-4a1b-925f-cd6b9e16da50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.625319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6ffba-2de9-4a1b-925f-cd6b9e16da50 admin admin] PATH_INFO: `/v3/projects/3776a3a3ea18437e9d7ebc73059809d9/users/55e55a51fd074a9cb90d2c6a60af46cf/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.627191 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6ffba-2de9-4a1b-925f-cd6b9e16da50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3776a3a3ea18437e9d7ebc73059809d9, user_id=55e55a51fd074a9cb90d2c6a60af46cf, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:20.630375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6ffba-2de9-4a1b-925f-cd6b9e16da50 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.641005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1163/2314] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:20 2022] PUT /identity/v3/projects/3776a3a3ea18437e9d7ebc73059809d9/users/55e55a51fd074a9cb90d2c6a60af46cf/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:20.651603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835a64d-6ecd-455f-ac7b-582fc01aa19e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.651922 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835a64d-6ecd-455f-ac7b-582fc01aa19e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.652198 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835a64d-6ecd-455f-ac7b-582fc01aa19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.679234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1835a64d-6ecd-455f-ac7b-582fc01aa19e None None] MFA Rules not processed for user `55e55a51fd074a9cb90d2c6a60af46cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:20.680480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1835a64d-6ecd-455f-ac7b-582fc01aa19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:20.685497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:20.750246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1152/2315] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:20.761362 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6ffba-2de9-4a1b-925f-cd6b9e16da50 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:20.763077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7ca6ffba-2de9-4a1b-925f-cd6b9e16da50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:20.819801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6ffba-2de9-4a1b-925f-cd6b9e16da50 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:20.823434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39febe3-ab9b-446e-b5d8-2f6add331ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:20.824292 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39febe3-ab9b-446e-b5d8-2f6add331ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:20.824567 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39febe3-ab9b-446e-b5d8-2f6add331ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:20.824835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39febe3-ab9b-446e-b5d8-2f6add331ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:20.880843 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39febe3-ab9b-446e-b5d8-2f6add331ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:20.882264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39febe3-ab9b-446e-b5d8-2f6add331ab5 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:20.890999 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1164/2316] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:23.445736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835a64d-6ecd-455f-ac7b-582fc01aa19e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:23.455509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835a64d-6ecd-455f-ac7b-582fc01aa19e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:23.459000 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016f90-dac9-47d9-af1e-291c1b5a8c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:23.459620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016f90-dac9-47d9-af1e-291c1b5a8c07 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:23.459895 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016f90-dac9-47d9-af1e-291c1b5a8c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:23.460163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016f90-dac9-47d9-af1e-291c1b5a8c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:23.468849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae016f90-dac9-47d9-af1e-291c1b5a8c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:23.470258 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae016f90-dac9-47d9-af1e-291c1b5a8c07 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:23.479970 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1153/2317] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:27.016365 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016d1b1-b709-4a45-ab0a-64867983e101 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:27.016848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016d1b1-b709-4a45-ab0a-64867983e101 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:27.017131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016d1b1-b709-4a45-ab0a-64867983e101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:27.030616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:27.037610 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e016d1b1-b709-4a45-ab0a-64867983e101 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:27.038907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e016d1b1-b709-4a45-ab0a-64867983e101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:27.101089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1165/2318] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:27:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:27.160268 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016f90-dac9-47d9-af1e-291c1b5a8c07 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:27.162271 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ae016f90-dac9-47d9-af1e-291c1b5a8c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:27.248064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016f90-dac9-47d9-af1e-291c1b5a8c07 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:27.253142 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dc69c-e091-448b-928e-420c81a20135 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:27.253754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dc69c-e091-448b-928e-420c81a20135 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:27.254035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dc69c-e091-448b-928e-420c81a20135 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:27.254311 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dc69c-e091-448b-928e-420c81a20135 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:27.264389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dc69c-e091-448b-928e-420c81a20135 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:27.265973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dc69c-e091-448b-928e-420c81a20135 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:27.275550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1154/2319] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:27:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:27:36.370670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016d1b1-b709-4a45-ab0a-64867983e101 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:36.431856 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016d1b1-b709-4a45-ab0a-64867983e101 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:36.436338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:36.436959 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:36.437239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:36.437510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] PATH_INFO: `/v3/users/2a479f4df29847bb8a381815bc306d9b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:36.438616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a479f4df29847bb8a381815bc306d9b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:36.440561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:36.486442 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a479f4df29847bb8a381815bc306d9b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:36.487084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a479f4df29847bb8a381815bc306d9b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:36.493530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a479f4df29847bb8a381815bc306d9b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:36.500597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a479f4df29847bb8a381815bc306d9b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:36.501261 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a479f4df29847bb8a381815bc306d9b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:36.518044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1166/2320] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:36 2022] DELETE /identity/v3/users/2a479f4df29847bb8a381815bc306d9b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:36.522967 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a5e37-b439-49ea-9edd-dcff9203a5f8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:36.523447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a5e37-b439-49ea-9edd-dcff9203a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:36.523695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a5e37-b439-49ea-9edd-dcff9203a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:36.548836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-dd1a5e37-b439-49ea-9edd-dcff9203a5f8 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:36.550037 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dd1a5e37-b439-49ea-9edd-dcff9203a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:36.607147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1155/2321] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:36.616771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:36.618164 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:36.652248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:36.680890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e725a-94d6-47b3-b60f-7ce38736c4bf admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:36.685606 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd750-dbe1-4a6f-b517-fe2d31f4d03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:36.686316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd750-dbe1-4a6f-b517-fe2d31f4d03c service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:36.686596 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd750-dbe1-4a6f-b517-fe2d31f4d03c service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:36.686873 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd750-dbe1-4a6f-b517-fe2d31f4d03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:36.696563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fd750-dbe1-4a6f-b517-fe2d31f4d03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:36.697985 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fd750-dbe1-4a6f-b517-fe2d31f4d03c service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:36.708411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1167/2322] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:36.984754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a5e37-b439-49ea-9edd-dcff9203a5f8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:36.986193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dd1a5e37-b439-49ea-9edd-dcff9203a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:37.025578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a5e37-b439-49ea-9edd-dcff9203a5f8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:37.033550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:37.034282 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:37.034559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:37.034834 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] PATH_INFO: `/v3/projects/000df3b56c294094aa0f1248ae9c1cd5` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:37.036053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000df3b56c294094aa0f1248ae9c1cd5)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:37.037965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:37.055707 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:37.089617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000df3b56c294094aa0f1248ae9c1cd5', 'request_id': 'req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.097456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000df3b56c294094aa0f1248ae9c1cd5', 'request_id': 'req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.103428 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000df3b56c294094aa0f1248ae9c1cd5', 'request_id': 'req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.114860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] The token cache is being invalidate because project 000df3b56c294094aa0f1248ae9c1cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:37.115067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.115806 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.117895 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1156/2323] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:36 2022] DELETE /identity/v3/projects/000df3b56c294094aa0f1248ae9c1cd5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:37.121522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd750-dbe1-4a6f-b517-fe2d31f4d03c service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:37.131748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd750-dbe1-4a6f-b517-fe2d31f4d03c service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:37.189761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:37.190397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:37.190676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:37.190952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] PATH_INFO: `/v3/users/55e55a51fd074a9cb90d2c6a60af46cf` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:37.192676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e55a51fd074a9cb90d2c6a60af46cf)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:37.194595 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:37.242481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e55a51fd074a9cb90d2c6a60af46cf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.243135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e55a51fd074a9cb90d2c6a60af46cf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.250787 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e55a51fd074a9cb90d2c6a60af46cf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.259116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e55a51fd074a9cb90d2c6a60af46cf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.259825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ac2a6121-ba08-49ad-bffc-e5102918b657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e55a51fd074a9cb90d2c6a60af46cf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.278247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1168/2324] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:37 2022] DELETE /identity/v3/users/55e55a51fd074a9cb90d2c6a60af46cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:37.704640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:37.706351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:37.721833 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58218ae1-7f5b-42d4-9ffd-eca7ef2e3ae4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:37.779583 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:37.780210 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:37.780489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:37.780761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] PATH_INFO: `/v3/projects/3776a3a3ea18437e9d7ebc73059809d9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:37.781867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3776a3a3ea18437e9d7ebc73059809d9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:37.783794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:37.828679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3776a3a3ea18437e9d7ebc73059809d9', 'request_id': 'req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.836746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3776a3a3ea18437e9d7ebc73059809d9', 'request_id': 'req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.842360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3776a3a3ea18437e9d7ebc73059809d9', 'request_id': 'req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.853280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] The token cache is being invalidate because project 3776a3a3ea18437e9d7ebc73059809d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:37.853567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.854187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ff37134f-a48e-4cdc-9a52-4da7ccfa1759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:37.855771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1157/2325] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:37 2022] DELETE /identity/v3/projects/3776a3a3ea18437e9d7ebc73059809d9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:37.860762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df888b1-ccd9-4f5d-a250-6d6992f30af3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:37.861228 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df888b1-ccd9-4f5d-a250-6d6992f30af3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:37.861444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df888b1-ccd9-4f5d-a250-6d6992f30af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:37.883086 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0df888b1-ccd9-4f5d-a250-6d6992f30af3 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:37.884372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0df888b1-ccd9-4f5d-a250-6d6992f30af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:37.930276 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:37.944020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1169/2326] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:37.953485 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cd16e-07f6-46c0-b7cb-1205f7aadb2a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:37.953775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cd16e-07f6-46c0-b7cb-1205f7aadb2a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:37.954082 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cd16e-07f6-46c0-b7cb-1205f7aadb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:37.974989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-fc1cd16e-07f6-46c0-b7cb-1205f7aadb2a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:37.976152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fc1cd16e-07f6-46c0-b7cb-1205f7aadb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:37.984143 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1158/2327] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:37.988467 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df888b1-ccd9-4f5d-a250-6d6992f30af3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:37.998100 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df888b1-ccd9-4f5d-a250-6d6992f30af3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.002788 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db72185-a029-4a0d-a017-f87c2d907517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.003453 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db72185-a029-4a0d-a017-f87c2d907517 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.003738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db72185-a029-4a0d-a017-f87c2d907517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.004012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db72185-a029-4a0d-a017-f87c2d907517 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.004683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db72185-a029-4a0d-a017-f87c2d907517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:27:38.004992 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db72185-a029-4a0d-a017-f87c2d907517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.006579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db72185-a029-4a0d-a017-f87c2d907517 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.018060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1170/2328] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:27:38.022721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cd16e-07f6-46c0-b7cb-1205f7aadb2a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.032336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cd16e-07f6-46c0-b7cb-1205f7aadb2a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.037750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c3308-05d3-47c1-90d2-df700f2f7f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.038068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c3308-05d3-47c1-90d2-df700f2f7f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.038343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c3308-05d3-47c1-90d2-df700f2f7f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.038614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c3308-05d3-47c1-90d2-df700f2f7f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.039244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c3308-05d3-47c1-90d2-df700f2f7f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.041175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c3308-05d3-47c1-90d2-df700f2f7f3b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.073067 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1159/2329] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:38 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:38.077556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db72185-a029-4a0d-a017-f87c2d907517 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.088232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db72185-a029-4a0d-a017-f87c2d907517 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.146368 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf46d4-3fa4-4c77-9920-a1c2c3833dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.147129 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf46d4-3fa4-4c77-9920-a1c2c3833dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.147451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf46d4-3fa4-4c77-9920-a1c2c3833dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.147734 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf46d4-3fa4-4c77-9920-a1c2c3833dcd admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.148398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf46d4-3fa4-4c77-9920-a1c2c3833dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.150344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf46d4-3fa4-4c77-9920-a1c2c3833dcd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.171254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1171/2330] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:38 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:38.175647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c3308-05d3-47c1-90d2-df700f2f7f3b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.183170 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:38.187355 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c3308-05d3-47c1-90d2-df700f2f7f3b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.194408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2f3c-16c0-4dcf-bed2-c1863e527a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.195500 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2f3c-16c0-4dcf-bed2-c1863e527a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.196087 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2f3c-16c0-4dcf-bed2-c1863e527a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.196311 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2f3c-16c0-4dcf-bed2-c1863e527a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.197252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a2f3c-16c0-4dcf-bed2-c1863e527a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.199543 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a2f3c-16c0-4dcf-bed2-c1863e527a4f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.212458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1160/2331] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:38.216412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf46d4-3fa4-4c77-9920-a1c2c3833dcd admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.226385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf46d4-3fa4-4c77-9920-a1c2c3833dcd admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.230782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08f40f-b8b5-4fb0-bab6-5533d7b5f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.231405 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f40f-b8b5-4fb0-bab6-5533d7b5f713 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.231683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f40f-b8b5-4fb0-bab6-5533d7b5f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.231953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08f40f-b8b5-4fb0-bab6-5533d7b5f713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.232586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08f40f-b8b5-4fb0-bab6-5533d7b5f713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.234177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08f40f-b8b5-4fb0-bab6-5533d7b5f713 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.245372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1172/2332] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:27:38.249598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2f3c-16c0-4dcf-bed2-c1863e527a4f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.260121 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2f3c-16c0-4dcf-bed2-c1863e527a4f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.264681 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718c96c-fba4-4292-80ea-14d2c16d6211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.265322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c96c-fba4-4292-80ea-14d2c16d6211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.265601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c96c-fba4-4292-80ea-14d2c16d6211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.265873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c96c-fba4-4292-80ea-14d2c16d6211 admin admin] PATH_INFO: `/v3/projects/17a96ed12cc64adfa65cef384a3e3093/users/981d77791d994eb69c12c45ba55616af/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.280277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718c96c-fba4-4292-80ea-14d2c16d6211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a96ed12cc64adfa65cef384a3e3093, user_id=981d77791d994eb69c12c45ba55616af, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.282918 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718c96c-fba4-4292-80ea-14d2c16d6211 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.295711 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1161/2333] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:38 2022] PUT /identity/v3/projects/17a96ed12cc64adfa65cef384a3e3093/users/981d77791d994eb69c12c45ba55616af/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:38.306183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9e412-3349-45be-aae0-8458e2493932 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.306472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9e412-3349-45be-aae0-8458e2493932 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.306743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9e412-3349-45be-aae0-8458e2493932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.334557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-70c9e412-3349-45be-aae0-8458e2493932 None None] MFA Rules not processed for user `981d77791d994eb69c12c45ba55616af`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:38.335794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-70c9e412-3349-45be-aae0-8458e2493932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:38.397859 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1173/2334] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:38.402318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718c96c-fba4-4292-80ea-14d2c16d6211 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.463686 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718c96c-fba4-4292-80ea-14d2c16d6211 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.468445 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a258fc1-3fc8-411b-a82b-9436fd2fc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.469043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a258fc1-3fc8-411b-a82b-9436fd2fc049 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.469322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a258fc1-3fc8-411b-a82b-9436fd2fc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.469600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a258fc1-3fc8-411b-a82b-9436fd2fc049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.470271 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a258fc1-3fc8-411b-a82b-9436fd2fc049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.472193 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a258fc1-3fc8-411b-a82b-9436fd2fc049 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.498772 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1162/2335] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:38 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:38.502891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9e412-3349-45be-aae0-8458e2493932 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.513418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9e412-3349-45be-aae0-8458e2493932 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.556827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:38.568984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c4c40-67e6-4c9f-aa47-b6c32daeb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.569582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c4c40-67e6-4c9f-aa47-b6c32daeb0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.569859 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c4c40-67e6-4c9f-aa47-b6c32daeb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.570131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c4c40-67e6-4c9f-aa47-b6c32daeb0cc admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.570784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c4c40-67e6-4c9f-aa47-b6c32daeb0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.572735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c4c40-67e6-4c9f-aa47-b6c32daeb0cc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.592919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1174/2336] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:38 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:27:38.597194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a258fc1-3fc8-411b-a82b-9436fd2fc049 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.607981 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a258fc1-3fc8-411b-a82b-9436fd2fc049 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.612616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8180d-d350-4f5d-8e34-8ad2d493358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.613212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8180d-d350-4f5d-8e34-8ad2d493358f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.613489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8180d-d350-4f5d-8e34-8ad2d493358f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.613761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8180d-d350-4f5d-8e34-8ad2d493358f admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.614972 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8180d-d350-4f5d-8e34-8ad2d493358f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.616605 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8180d-d350-4f5d-8e34-8ad2d493358f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.626945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1163/2337] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:38.630938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c4c40-67e6-4c9f-aa47-b6c32daeb0cc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.640557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c4c40-67e6-4c9f-aa47-b6c32daeb0cc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.645256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ff3c-7b0c-4b46-8d55-82aa905517df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.645906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ff3c-7b0c-4b46-8d55-82aa905517df admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.646184 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ff3c-7b0c-4b46-8d55-82aa905517df admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.646458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ff3c-7b0c-4b46-8d55-82aa905517df admin admin] PATH_INFO: `/v3/projects/43ca3559784e4541936b2a0e8e708f23/users/f5f0c2ba476a4c34895c8756319f3778/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.661808 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240ff3c-7b0c-4b46-8d55-82aa905517df admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ca3559784e4541936b2a0e8e708f23, user_id=f5f0c2ba476a4c34895c8756319f3778, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.664557 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240ff3c-7b0c-4b46-8d55-82aa905517df admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.677734 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1175/2338] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:38 2022] PUT /identity/v3/projects/43ca3559784e4541936b2a0e8e708f23/users/f5f0c2ba476a4c34895c8756319f3778/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:27:38.681827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8180d-d350-4f5d-8e34-8ad2d493358f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.691687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8180d-d350-4f5d-8e34-8ad2d493358f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.746225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594328e-4024-48c5-a8e1-afe0397c7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.746842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594328e-4024-48c5-a8e1-afe0397c7eef admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.747086 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594328e-4024-48c5-a8e1-afe0397c7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.747397 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594328e-4024-48c5-a8e1-afe0397c7eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.748027 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594328e-4024-48c5-a8e1-afe0397c7eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.749754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594328e-4024-48c5-a8e1-afe0397c7eef admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.759306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1164/2339] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:38.763589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ff3c-7b0c-4b46-8d55-82aa905517df admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.774359 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ff3c-7b0c-4b46-8d55-82aa905517df admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.779124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288268e-e877-4aea-9a8a-d62628896067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.779810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288268e-e877-4aea-9a8a-d62628896067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.780092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288268e-e877-4aea-9a8a-d62628896067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.780366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288268e-e877-4aea-9a8a-d62628896067 admin admin] PATH_INFO: `/v3/projects/43ca3559784e4541936b2a0e8e708f23/users/f5f0c2ba476a4c34895c8756319f3778/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.782265 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288268e-e877-4aea-9a8a-d62628896067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ca3559784e4541936b2a0e8e708f23, user_id=f5f0c2ba476a4c34895c8756319f3778, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.784933 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288268e-e877-4aea-9a8a-d62628896067 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.795613 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1176/2340] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:38 2022] PUT /identity/v3/projects/43ca3559784e4541936b2a0e8e708f23/users/f5f0c2ba476a4c34895c8756319f3778/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:38.806448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f877-6430-4dd6-ae1d-e26be054cd5e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.806837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f877-6430-4dd6-ae1d-e26be054cd5e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.807116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f877-6430-4dd6-ae1d-e26be054cd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.834866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3a31f877-6430-4dd6-ae1d-e26be054cd5e None None] MFA Rules not processed for user `f5f0c2ba476a4c34895c8756319f3778`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:38.836088 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3a31f877-6430-4dd6-ae1d-e26be054cd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:38.864847 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:38.903861 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1165/2341] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:38.915313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288268e-e877-4aea-9a8a-d62628896067 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:38.916994 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f288268e-e877-4aea-9a8a-d62628896067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:38.974088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288268e-e877-4aea-9a8a-d62628896067 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:38.977736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f2d2c-4db5-41fb-8bd7-6fb059797642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:38.978335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f2d2c-4db5-41fb-8bd7-6fb059797642 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:38.978615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f2d2c-4db5-41fb-8bd7-6fb059797642 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:38.978885 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f2d2c-4db5-41fb-8bd7-6fb059797642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:38.987709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f2d2c-4db5-41fb-8bd7-6fb059797642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:38.989137 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f2d2c-4db5-41fb-8bd7-6fb059797642 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:38.998362 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1177/2342] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:39.063022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31f877-6430-4dd6-ae1d-e26be054cd5e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:39.125398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31f877-6430-4dd6-ae1d-e26be054cd5e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:39.130622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:39.131357 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:39.131670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:39.131880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] PATH_INFO: `/v3/users/981d77791d994eb69c12c45ba55616af` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:39.133034 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=981d77791d994eb69c12c45ba55616af)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:39.134994 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:39.183124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981d77791d994eb69c12c45ba55616af'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.190517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981d77791d994eb69c12c45ba55616af'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.199851 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981d77791d994eb69c12c45ba55616af'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.214304 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981d77791d994eb69c12c45ba55616af'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.215223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981d77791d994eb69c12c45ba55616af'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.221618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1166/2343] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:39 2022] DELETE /identity/v3/users/981d77791d994eb69c12c45ba55616af => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:39.225929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eed99-d5cb-44d6-9bbd-7006c5135f29 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:39.226452 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eed99-d5cb-44d6-9bbd-7006c5135f29 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:39.226829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eed99-d5cb-44d6-9bbd-7006c5135f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:39.250351 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c62eed99-d5cb-44d6-9bbd-7006c5135f29 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:39.251650 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c62eed99-d5cb-44d6-9bbd-7006c5135f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:39.330424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1178/2344] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:39.341559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:39.343215 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:39.392907 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:39.406048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e5776-563a-455e-aa11-ed276263fa94 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:39.410048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd648f-9091-4903-ab0f-5df710bc7b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:39.410696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd648f-9091-4903-ab0f-5df710bc7b03 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:39.410956 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd648f-9091-4903-ab0f-5df710bc7b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:39.411227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd648f-9091-4903-ab0f-5df710bc7b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:39.420203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd648f-9091-4903-ab0f-5df710bc7b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:39.421660 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd648f-9091-4903-ab0f-5df710bc7b03 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:39.431313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1167/2345] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:39.706499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eed99-d5cb-44d6-9bbd-7006c5135f29 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:39.708694 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c62eed99-d5cb-44d6-9bbd-7006c5135f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:39.722171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eed99-d5cb-44d6-9bbd-7006c5135f29 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:39.727426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:39.728065 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:39.728342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:39.728713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] PATH_INFO: `/v3/projects/17a96ed12cc64adfa65cef384a3e3093` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:39.729753 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a96ed12cc64adfa65cef384a3e3093)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:39.731709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:39.772485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:39.780831 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a96ed12cc64adfa65cef384a3e3093', 'request_id': 'req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.786849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a96ed12cc64adfa65cef384a3e3093', 'request_id': 'req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.793012 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a96ed12cc64adfa65cef384a3e3093', 'request_id': 'req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.804404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] The token cache is being invalidate because project 17a96ed12cc64adfa65cef384a3e3093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:39.804691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.805316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.806791 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1179/2346] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:39 2022] DELETE /identity/v3/projects/17a96ed12cc64adfa65cef384a3e3093 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:39.810740 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd648f-9091-4903-ab0f-5df710bc7b03 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:39.820924 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd648f-9091-4903-ab0f-5df710bc7b03 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:39.876026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:39.876645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:39.876921 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:39.877191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] PATH_INFO: `/v3/users/f5f0c2ba476a4c34895c8756319f3778` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:39.878303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f0c2ba476a4c34895c8756319f3778)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:39.880760 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:39.925755 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f0c2ba476a4c34895c8756319f3778'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.932675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f0c2ba476a4c34895c8756319f3778'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.939405 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f0c2ba476a4c34895c8756319f3778'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.951939 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f0c2ba476a4c34895c8756319f3778'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.952562 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-82307c0b-134c-459a-ba90-7f7c848de7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f0c2ba476a4c34895c8756319f3778'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:39.958908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1168/2347] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:39 2022] DELETE /identity/v3/users/f5f0c2ba476a4c34895c8756319f3778 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:40.232924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:40.234393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:40.255956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354ca5f-6a91-48f7-b2d2-bd9a3eac3a32 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:40.311111 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:40.311689 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:40.311965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:40.312235 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] PATH_INFO: `/v3/projects/43ca3559784e4541936b2a0e8e708f23` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:40.313326 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ca3559784e4541936b2a0e8e708f23)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:40.315200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:40.361172 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ca3559784e4541936b2a0e8e708f23', 'request_id': 'req-00ba1402-be36-4892-8dc5-184b2b591446'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:40.367234 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ca3559784e4541936b2a0e8e708f23', 'request_id': 'req-00ba1402-be36-4892-8dc5-184b2b591446'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:40.373394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ca3559784e4541936b2a0e8e708f23', 'request_id': 'req-00ba1402-be36-4892-8dc5-184b2b591446'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:40.386244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] The token cache is being invalidate because project 43ca3559784e4541936b2a0e8e708f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:40.386528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:40.387212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-00ba1402-be36-4892-8dc5-184b2b591446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:40.388773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1180/2348] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:40 2022] DELETE /identity/v3/projects/43ca3559784e4541936b2a0e8e708f23 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:40.393730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9d045-6a0a-4fc0-9297-ca8f14c6fc01 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:40.394026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9d045-6a0a-4fc0-9297-ca8f14c6fc01 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:40.394332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9d045-6a0a-4fc0-9297-ca8f14c6fc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:40.414096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c1e9d045-6a0a-4fc0-9297-ca8f14c6fc01 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:40.415331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c1e9d045-6a0a-4fc0-9297-ca8f14c6fc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:40.475141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1169/2349] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:40.483051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466872-17f2-407e-ab30-0ca1adf14364 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:40.483361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466872-17f2-407e-ab30-0ca1adf14364 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:40.483639 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466872-17f2-407e-ab30-0ca1adf14364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:40.504176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b3466872-17f2-407e-ab30-0ca1adf14364 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:40.505956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b3466872-17f2-407e-ab30-0ca1adf14364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:40.515362 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1181/2350] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:40.519582 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9d045-6a0a-4fc0-9297-ca8f14c6fc01 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:40.529393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9d045-6a0a-4fc0-9297-ca8f14c6fc01 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:40.534074 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa0896-651f-4faa-9ad5-3bf935f19e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:40.534824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa0896-651f-4faa-9ad5-3bf935f19e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:40.535145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa0896-651f-4faa-9ad5-3bf935f19e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:40.535457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa0896-651f-4faa-9ad5-3bf935f19e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:40.536109 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa0896-651f-4faa-9ad5-3bf935f19e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:27:40.536444 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa0896-651f-4faa-9ad5-3bf935f19e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:40.538030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa0896-651f-4faa-9ad5-3bf935f19e12 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:40.539599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:40.555554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1170/2351] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:27:40.556696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466872-17f2-407e-ab30-0ca1adf14364 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:40.566492 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466872-17f2-407e-ab30-0ca1adf14364 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:40.571813 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6abf5-7299-425a-bc23-ad5b839af457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:40.572451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6abf5-7299-425a-bc23-ad5b839af457 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:40.572730 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6abf5-7299-425a-bc23-ad5b839af457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:40.573006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6abf5-7299-425a-bc23-ad5b839af457 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:40.573892 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6abf5-7299-425a-bc23-ad5b839af457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:40.575790 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6abf5-7299-425a-bc23-ad5b839af457 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:40.603882 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1182/2352] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:40 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:40.608312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa0896-651f-4faa-9ad5-3bf935f19e12 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:40.618383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa0896-651f-4faa-9ad5-3bf935f19e12 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:40.676710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567a3b5-0e77-4a04-adef-5076d4ffc6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:40.677376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567a3b5-0e77-4a04-adef-5076d4ffc6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:40.677653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567a3b5-0e77-4a04-adef-5076d4ffc6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:40.677944 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567a3b5-0e77-4a04-adef-5076d4ffc6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:40.678700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567a3b5-0e77-4a04-adef-5076d4ffc6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:40.680881 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567a3b5-0e77-4a04-adef-5076d4ffc6c2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:40.709191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1171/2353] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:40 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:40.710316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6abf5-7299-425a-bc23-ad5b839af457 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:40.720968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6abf5-7299-425a-bc23-ad5b839af457 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:40.725681 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e128fa8-8afd-4360-8375-53ee0a3f3934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:40.726290 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e128fa8-8afd-4360-8375-53ee0a3f3934 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:40.726568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e128fa8-8afd-4360-8375-53ee0a3f3934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:40.726844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e128fa8-8afd-4360-8375-53ee0a3f3934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:40.727526 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e128fa8-8afd-4360-8375-53ee0a3f3934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:40.729093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e128fa8-8afd-4360-8375-53ee0a3f3934 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:40.742232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1183/2354] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:40.743611 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567a3b5-0e77-4a04-adef-5076d4ffc6c2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:40.753940 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567a3b5-0e77-4a04-adef-5076d4ffc6c2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:40.760745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32221364-397a-4afb-bc1b-62d617578dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:40.761416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32221364-397a-4afb-bc1b-62d617578dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:40.761736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32221364-397a-4afb-bc1b-62d617578dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:40.762053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32221364-397a-4afb-bc1b-62d617578dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:40.762792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32221364-397a-4afb-bc1b-62d617578dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:40.764722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32221364-397a-4afb-bc1b-62d617578dc3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:40.776407 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1172/2355] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:40.780702 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e128fa8-8afd-4360-8375-53ee0a3f3934 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:40.791441 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e128fa8-8afd-4360-8375-53ee0a3f3934 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:40.796514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048490a2-a442-49d5-872c-34ad87f1bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:40.796844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048490a2-a442-49d5-872c-34ad87f1bde1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:40.797126 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048490a2-a442-49d5-872c-34ad87f1bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:40.797738 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048490a2-a442-49d5-872c-34ad87f1bde1 admin admin] PATH_INFO: `/v3/projects/2751d5c3ca784f469ba02fef7a501312/users/56cdaa959fe949398e900ced6f8933a4/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:40.813701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048490a2-a442-49d5-872c-34ad87f1bde1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2751d5c3ca784f469ba02fef7a501312, user_id=56cdaa959fe949398e900ced6f8933a4, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:40.816318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048490a2-a442-49d5-872c-34ad87f1bde1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:40.819159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:40.832263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1184/2356] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:40 2022] PUT /identity/v3/projects/2751d5c3ca784f469ba02fef7a501312/users/56cdaa959fe949398e900ced6f8933a4/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:27:40.843329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64085-4a8b-4117-8696-18aad981f8d4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:40.844394 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64085-4a8b-4117-8696-18aad981f8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:40.845507 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64085-4a8b-4117-8696-18aad981f8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:40.874027 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d3e64085-4a8b-4117-8696-18aad981f8d4 None None] MFA Rules not processed for user `56cdaa959fe949398e900ced6f8933a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:40.875240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d3e64085-4a8b-4117-8696-18aad981f8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:40.943422 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1173/2357] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:40.948032 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048490a2-a442-49d5-872c-34ad87f1bde1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.013900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048490a2-a442-49d5-872c-34ad87f1bde1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.018576 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afb114-2a20-40fa-bf71-09548db3acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.019180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afb114-2a20-40fa-bf71-09548db3acd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.019551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afb114-2a20-40fa-bf71-09548db3acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.019827 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afb114-2a20-40fa-bf71-09548db3acd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.020485 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afb114-2a20-40fa-bf71-09548db3acd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.022394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afb114-2a20-40fa-bf71-09548db3acd3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.056868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1185/2358] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:40 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:41.059785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64085-4a8b-4117-8696-18aad981f8d4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.078950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64085-4a8b-4117-8696-18aad981f8d4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.136625 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c3863-6210-457f-9e86-ce4baa51df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.137261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3863-6210-457f-9e86-ce4baa51df04 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.137524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3863-6210-457f-9e86-ce4baa51df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.137796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3863-6210-457f-9e86-ce4baa51df04 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.138568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c3863-6210-457f-9e86-ce4baa51df04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.140580 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c3863-6210-457f-9e86-ce4baa51df04 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.151043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:41.167075 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1174/2359] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:41 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:41.170727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afb114-2a20-40fa-bf71-09548db3acd3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.182909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afb114-2a20-40fa-bf71-09548db3acd3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.186740 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c677b6e-cda4-48fd-bb88-838e4d0ed967 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.187416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c677b6e-cda4-48fd-bb88-838e4d0ed967 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.187759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c677b6e-cda4-48fd-bb88-838e4d0ed967 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.187872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4830a8f-988e-4193-83a0-486907d85435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.188454 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830a8f-988e-4193-83a0-486907d85435 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.188735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830a8f-988e-4193-83a0-486907d85435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.189006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830a8f-988e-4193-83a0-486907d85435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.189479 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1175/2360] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:27:41.189744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4830a8f-988e-4193-83a0-486907d85435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.191461 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4830a8f-988e-4193-83a0-486907d85435 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.195945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243892-47d5-4dd7-865e-0545a48fc37f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.196228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243892-47d5-4dd7-865e-0545a48fc37f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.196503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243892-47d5-4dd7-865e-0545a48fc37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.207370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1186/2361] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:27:41.208495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4830a8f-988e-4193-83a0-486907d85435 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.218354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4830a8f-988e-4193-83a0-486907d85435 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.221906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-18243892-47d5-4dd7-865e-0545a48fc37f None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:41.223064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11dfb1-dbc6-4d77-95cc-b6757fce7f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.223224 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-18243892-47d5-4dd7-865e-0545a48fc37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:41.223784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11dfb1-dbc6-4d77-95cc-b6757fce7f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.224064 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11dfb1-dbc6-4d77-95cc-b6757fce7f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.224399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11dfb1-dbc6-4d77-95cc-b6757fce7f50 admin admin] PATH_INFO: `/v3/projects/6164cc12109d45a39a0df7e739eac3d3/users/f6730402c5214b9e909cfc5aa3edd620/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.242556 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11dfb1-dbc6-4d77-95cc-b6757fce7f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6164cc12109d45a39a0df7e739eac3d3, user_id=f6730402c5214b9e909cfc5aa3edd620, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.245427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11dfb1-dbc6-4d77-95cc-b6757fce7f50 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.264708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1187/2362] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:41 2022] PUT /identity/v3/projects/6164cc12109d45a39a0df7e739eac3d3/users/f6730402c5214b9e909cfc5aa3edd620/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:27:41.268333 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11dfb1-dbc6-4d77-95cc-b6757fce7f50 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.305359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1176/2363] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:41.318897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18243892-47d5-4dd7-865e-0545a48fc37f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.320685 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-18243892-47d5-4dd7-865e-0545a48fc37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:41.354090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11dfb1-dbc6-4d77-95cc-b6757fce7f50 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.358950 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d73b5-4ac0-45d0-85d2-674d4ea944dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.359723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d73b5-4ac0-45d0-85d2-674d4ea944dc admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.360067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d73b5-4ac0-45d0-85d2-674d4ea944dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.360428 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d73b5-4ac0-45d0-85d2-674d4ea944dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.361135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d73b5-4ac0-45d0-85d2-674d4ea944dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.362862 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d73b5-4ac0-45d0-85d2-674d4ea944dc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.376397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1188/2364] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:27:41.377608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d73b5-4ac0-45d0-85d2-674d4ea944dc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.380025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18243892-47d5-4dd7-865e-0545a48fc37f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.387354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d73b5-4ac0-45d0-85d2-674d4ea944dc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.392039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56d919-6e63-4e87-ae96-9b86f8546726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.392674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56d919-6e63-4e87-ae96-9b86f8546726 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.392953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56d919-6e63-4e87-ae96-9b86f8546726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.393231 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56d919-6e63-4e87-ae96-9b86f8546726 admin admin] PATH_INFO: `/v3/projects/6164cc12109d45a39a0df7e739eac3d3/users/f6730402c5214b9e909cfc5aa3edd620/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.395180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56d919-6e63-4e87-ae96-9b86f8546726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6164cc12109d45a39a0df7e739eac3d3, user_id=f6730402c5214b9e909cfc5aa3edd620, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.397840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56d919-6e63-4e87-ae96-9b86f8546726 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.408238 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1189/2365] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:41 2022] PUT /identity/v3/projects/6164cc12109d45a39a0df7e739eac3d3/users/f6730402c5214b9e909cfc5aa3edd620/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:27:41.419699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6318c-b93c-49a3-b602-5da3a1cc849b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.419984 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6318c-b93c-49a3-b602-5da3a1cc849b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.420260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6318c-b93c-49a3-b602-5da3a1cc849b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.429778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055910ed-4b5f-4440-80b8-fff02d979be4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec1b2a49264e4e9218b65f9ff114b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.430389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055910ed-4b5f-4440-80b8-fff02d979be4 service glance] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.430683 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055910ed-4b5f-4440-80b8-fff02d979be4 service glance] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.430935 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055910ed-4b5f-4440-80b8-fff02d979be4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.448145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e1a6318c-b93c-49a3-b602-5da3a1cc849b None None] MFA Rules not processed for user `f6730402c5214b9e909cfc5aa3edd620`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:41.449646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e1a6318c-b93c-49a3-b602-5da3a1cc849b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:41.462183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:41.481492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:41.500642 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055910ed-4b5f-4440-80b8-fff02d979be4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.502068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055910ed-4b5f-4440-80b8-fff02d979be4 service glance] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.513201 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1177/2366] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:27:41.521313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1190/2367] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:41.531809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055910ed-4b5f-4440-80b8-fff02d979be4 service glance] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.533158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-055910ed-4b5f-4440-80b8-fff02d979be4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:41.584907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875b8e-0a02-4c55-89b6-edf00d13a121 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.585116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875b8e-0a02-4c55-89b6-edf00d13a121 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.585374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875b8e-0a02-4c55-89b6-edf00d13a121 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.586895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1191/2368] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:27:41.591211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b26c-8028-4d84-bf23-e0750ebf595e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.591510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b26c-8028-4d84-bf23-e0750ebf595e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.591783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b26c-8028-4d84-bf23-e0750ebf595e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.592268 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055910ed-4b5f-4440-80b8-fff02d979be4 service glance] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.613145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-05a8b26c-8028-4d84-bf23-e0750ebf595e None None] MFA Rules not processed for user `ad7ef5b260e4425c93ebbe85570136db`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:41.614361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-05a8b26c-8028-4d84-bf23-e0750ebf595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:41.640322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3343a4-57cf-47cc-9b1b-fd5e22d288f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.640932 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3343a4-57cf-47cc-9b1b-fd5e22d288f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.641207 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3343a4-57cf-47cc-9b1b-fd5e22d288f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.641478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3343a4-57cf-47cc-9b1b-fd5e22d288f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.650971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3343a4-57cf-47cc-9b1b-fd5e22d288f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.652424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3343a4-57cf-47cc-9b1b-fd5e22d288f6 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.662497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1178/2369] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:41.667384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1192/2370] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:41.679369 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3343a4-57cf-47cc-9b1b-fd5e22d288f6 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.680808 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-da3343a4-57cf-47cc-9b1b-fd5e22d288f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:41.693289 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3343a4-57cf-47cc-9b1b-fd5e22d288f6 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.697004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f7865-457b-48f8-8346-5f50a33d5770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.697606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7865-457b-48f8-8346-5f50a33d5770 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.697888 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7865-457b-48f8-8346-5f50a33d5770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.698167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f7865-457b-48f8-8346-5f50a33d5770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.713670 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f7865-457b-48f8-8346-5f50a33d5770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.715238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f7865-457b-48f8-8346-5f50a33d5770 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.723724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1179/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:27:41.767392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b26c-8028-4d84-bf23-e0750ebf595e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.776663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b26c-8028-4d84-bf23-e0750ebf595e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.780340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d6d74-7c19-4947-8d5e-12be00466ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.780947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d6d74-7c19-4947-8d5e-12be00466ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.781230 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d6d74-7c19-4947-8d5e-12be00466ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.781491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d6d74-7c19-4947-8d5e-12be00466ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.812505 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bb1aa-719f-4b42-8d37-3a449f612126 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.812791 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bb1aa-719f-4b42-8d37-3a449f612126 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.813064 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bb1aa-719f-4b42-8d37-3a449f612126 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.814448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1180/2372] 10.222.0.23 () {54 vars in 921 bytes} [Fri Oct 21 21:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 21 21:27:41.820054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649223d-a54c-40df-9f83-a63ed717d5a7 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.820343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649223d-a54c-40df-9f83-a63ed717d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.820621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649223d-a54c-40df-9f83-a63ed717d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.840195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d6d74-7c19-4947-8d5e-12be00466ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.840372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1649223d-a54c-40df-9f83-a63ed717d5a7 None None] MFA Rules not processed for user `8afe54a4c63b4a50a6240293e2be6450`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:41.841406 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1649223d-a54c-40df-9f83-a63ed717d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:41.841540 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d6d74-7c19-4947-8d5e-12be00466ce4 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.850853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1193/2373] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:41.911022 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1181/2374] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Oct 21 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:41.921712 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d6d74-7c19-4947-8d5e-12be00466ce4 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:41.923321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6c5d6d74-7c19-4947-8d5e-12be00466ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:41.936697 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d6d74-7c19-4947-8d5e-12be00466ce4 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:41.940264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf9ad7-e6ef-491f-ac65-b551a781dde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:41.940857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf9ad7-e6ef-491f-ac65-b551a781dde3 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:41.941128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf9ad7-e6ef-491f-ac65-b551a781dde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:41.941398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf9ad7-e6ef-491f-ac65-b551a781dde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:41.953163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf9ad7-e6ef-491f-ac65-b551a781dde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:41.954598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf9ad7-e6ef-491f-ac65-b551a781dde3 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:41.966684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1194/2375] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:44.369414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4d8f-e618-40f8-b70b-e2898c313997 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:44.369869 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4d8f-e618-40f8-b70b-e2898c313997 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:44.369986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4d8f-e618-40f8-b70b-e2898c313997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:44.389335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b62d4d8f-e618-40f8-b70b-e2898c313997 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:44.390526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b62d4d8f-e618-40f8-b70b-e2898c313997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:44.402980 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:44.440107 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf9ad7-e6ef-491f-ac65-b551a781dde3 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:44.447245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1182/2376] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:27:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:44.459821 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d4d8f-e618-40f8-b70b-e2898c313997 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:44.461166 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b62d4d8f-e618-40f8-b70b-e2898c313997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:44.490683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:44.506531 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf9ad7-e6ef-491f-ac65-b551a781dde3 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:44.512195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:44.512829 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:44.513108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:44.513383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] PATH_INFO: `/v3/users/56cdaa959fe949398e900ced6f8933a4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:44.514491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56cdaa959fe949398e900ced6f8933a4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:44.516434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:44.531096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d4d8f-e618-40f8-b70b-e2898c313997 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:44.536145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d01f9-9222-49dc-8906-661552f2836a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:44.536745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d01f9-9222-49dc-8906-661552f2836a service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:44.537020 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d01f9-9222-49dc-8906-661552f2836a service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:44.537292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d01f9-9222-49dc-8906-661552f2836a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:44.545939 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d01f9-9222-49dc-8906-661552f2836a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:44.547864 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d01f9-9222-49dc-8906-661552f2836a service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:44.556574 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1183/2377] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:27:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 21 21:27:44.563906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56cdaa959fe949398e900ced6f8933a4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:44.564559 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56cdaa959fe949398e900ced6f8933a4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:44.573562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56cdaa959fe949398e900ced6f8933a4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:44.580820 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56cdaa959fe949398e900ced6f8933a4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:44.581527 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56cdaa959fe949398e900ced6f8933a4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:44.600937 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1195/2378] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:44 2022] DELETE /identity/v3/users/56cdaa959fe949398e900ced6f8933a4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:27:44.605443 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808516-a419-4fae-bf4b-96a90c22ca47 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:44.605734 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808516-a419-4fae-bf4b-96a90c22ca47 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:44.606011 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808516-a419-4fae-bf4b-96a90c22ca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:44.633456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-81808516-a419-4fae-bf4b-96a90c22ca47 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:44.635360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-81808516-a419-4fae-bf4b-96a90c22ca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:44.713306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1184/2379] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:44.720037 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:44.721519 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:44.830837 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cee7d-c699-4781-a59a-d2a1edcfff6d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:44.836612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799592e2-f3f3-45a5-ada1-8126a436879f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:44.838435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799592e2-f3f3-45a5-ada1-8126a436879f service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:44.838793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799592e2-f3f3-45a5-ada1-8126a436879f service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:44.840207 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799592e2-f3f3-45a5-ada1-8126a436879f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:44.860407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799592e2-f3f3-45a5-ada1-8126a436879f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:44.864641 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799592e2-f3f3-45a5-ada1-8126a436879f service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:44.895538 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1196/2380] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:27:45.281060 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81808516-a419-4fae-bf4b-96a90c22ca47 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:45.282815 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-81808516-a419-4fae-bf4b-96a90c22ca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:45.302096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81808516-a419-4fae-bf4b-96a90c22ca47 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:45.309847 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:45.311616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:45.312098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:45.312606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] PATH_INFO: `/v3/projects/2751d5c3ca784f469ba02fef7a501312` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:45.315171 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2751d5c3ca784f469ba02fef7a501312)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:45.317586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:45.382622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:45.384350 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2751d5c3ca784f469ba02fef7a501312', 'request_id': 'req-5a410c25-0829-4460-b3aa-75f524294231'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:45.392727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2751d5c3ca784f469ba02fef7a501312', 'request_id': 'req-5a410c25-0829-4460-b3aa-75f524294231'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:45.398843 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2751d5c3ca784f469ba02fef7a501312', 'request_id': 'req-5a410c25-0829-4460-b3aa-75f524294231'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:45.412124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] The token cache is being invalidate because project 2751d5c3ca784f469ba02fef7a501312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:45.412416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:45.413080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:45.414788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1185/2381] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:45 2022] DELETE /identity/v3/projects/2751d5c3ca784f469ba02fef7a501312 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:45.418693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799592e2-f3f3-45a5-ada1-8126a436879f service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:45.429042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799592e2-f3f3-45a5-ada1-8126a436879f service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:45.494132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:45.494926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:45.495295 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:45.495744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] PATH_INFO: `/v3/users/f6730402c5214b9e909cfc5aa3edd620` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:45.496997 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6730402c5214b9e909cfc5aa3edd620)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:45.499016 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:45.510032 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:45.557795 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6730402c5214b9e909cfc5aa3edd620'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:45.558375 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6730402c5214b9e909cfc5aa3edd620'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:45.566564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6730402c5214b9e909cfc5aa3edd620'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:45.576711 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6730402c5214b9e909cfc5aa3edd620'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:45.577729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2ba9ddf7-134d-4ce9-8dc5-b402b98b0ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6730402c5214b9e909cfc5aa3edd620'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:45.600294 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1197/2382] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:45 2022] DELETE /identity/v3/users/f6730402c5214b9e909cfc5aa3edd620 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:45.921557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:45.923006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:45.937891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a410c25-0829-4460-b3aa-75f524294231 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:46.019023 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:46.019700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.020578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.020851 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] PATH_INFO: `/v3/projects/6164cc12109d45a39a0df7e739eac3d3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.022030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6164cc12109d45a39a0df7e739eac3d3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:46.023964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:46.105677 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6164cc12109d45a39a0df7e739eac3d3', 'request_id': 'req-9e26189e-2b63-4146-b0d9-5e73e3320bf3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:46.127717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6164cc12109d45a39a0df7e739eac3d3', 'request_id': 'req-9e26189e-2b63-4146-b0d9-5e73e3320bf3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:46.144789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6164cc12109d45a39a0df7e739eac3d3', 'request_id': 'req-9e26189e-2b63-4146-b0d9-5e73e3320bf3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:46.162626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] The token cache is being invalidate because project 6164cc12109d45a39a0df7e739eac3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:46.163181 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:46.166232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9e26189e-2b63-4146-b0d9-5e73e3320bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:46.175105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1186/2383] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:45 2022] DELETE /identity/v3/projects/6164cc12109d45a39a0df7e739eac3d3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:46.177401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a861b2-f1f7-485d-afe5-9d13fa8bf3a7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.177693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a861b2-f1f7-485d-afe5-9d13fa8bf3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.177970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a861b2-f1f7-485d-afe5-9d13fa8bf3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.215042 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-35a861b2-f1f7-485d-afe5-9d13fa8bf3a7 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:46.216401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-35a861b2-f1f7-485d-afe5-9d13fa8bf3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:46.293309 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1198/2384] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:46.301276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57554fec-0334-4a37-872c-26b4e4b1cd76 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.301564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57554fec-0334-4a37-872c-26b4e4b1cd76 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.301867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57554fec-0334-4a37-872c-26b4e4b1cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.325537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-57554fec-0334-4a37-872c-26b4e4b1cd76 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:46.326777 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-57554fec-0334-4a37-872c-26b4e4b1cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:46.337219 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1187/2385] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:46.341578 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a861b2-f1f7-485d-afe5-9d13fa8bf3a7 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:46.352262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a861b2-f1f7-485d-afe5-9d13fa8bf3a7 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:46.357173 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd82d9-cece-470e-b5ba-fcccc393ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:46.357793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd82d9-cece-470e-b5ba-fcccc393ec7d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.358204 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd82d9-cece-470e-b5ba-fcccc393ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.358383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd82d9-cece-470e-b5ba-fcccc393ec7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.359045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd82d9-cece-470e-b5ba-fcccc393ec7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:27:46.359403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd82d9-cece-470e-b5ba-fcccc393ec7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:46.361361 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd82d9-cece-470e-b5ba-fcccc393ec7d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:46.379799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1199/2386] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:27:46.381135 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57554fec-0334-4a37-872c-26b4e4b1cd76 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:46.390823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57554fec-0334-4a37-872c-26b4e4b1cd76 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:46.396462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c15216-6136-42c9-9657-7611e0924540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:46.397172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c15216-6136-42c9-9657-7611e0924540 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.397518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c15216-6136-42c9-9657-7611e0924540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.397858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c15216-6136-42c9-9657-7611e0924540 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.398593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c15216-6136-42c9-9657-7611e0924540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:46.400597 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c15216-6136-42c9-9657-7611e0924540 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:46.429786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1188/2387] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:46 2022] POST /identity/v3/projects => generated 409 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:46.434013 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd82d9-cece-470e-b5ba-fcccc393ec7d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:46.444810 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd82d9-cece-470e-b5ba-fcccc393ec7d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:46.508971 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a702b-ff82-4782-a7f2-441534cbef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:46.509783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a702b-ff82-4782-a7f2-441534cbef40 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.510047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a702b-ff82-4782-a7f2-441534cbef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.510374 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a702b-ff82-4782-a7f2-441534cbef40 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.511032 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a702b-ff82-4782-a7f2-441534cbef40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:46.512993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a702b-ff82-4782-a7f2-441534cbef40 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:46.537395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1200/2388] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:46 2022] POST /identity/v3/users => generated 305 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:46.541561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c15216-6136-42c9-9657-7611e0924540 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:46.553522 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c15216-6136-42c9-9657-7611e0924540 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:46.559393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe58a-1a22-4e7d-9887-d5f2bc8ebb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:46.560380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe58a-1a22-4e7d-9887-d5f2bc8ebb81 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.560380 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe58a-1a22-4e7d-9887-d5f2bc8ebb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.560656 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe58a-1a22-4e7d-9887-d5f2bc8ebb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.561202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfe58a-1a22-4e7d-9887-d5f2bc8ebb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:46.562937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfe58a-1a22-4e7d-9887-d5f2bc8ebb81 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:46.574998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1189/2389] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:27:46.578964 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a702b-ff82-4782-a7f2-441534cbef40 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:46.587670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:46.595216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a702b-ff82-4782-a7f2-441534cbef40 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:46.602821 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d902d-d56a-46b2-8182-4d69f0dc2cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:46.603767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d902d-d56a-46b2-8182-4d69f0dc2cde admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.604202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d902d-d56a-46b2-8182-4d69f0dc2cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.604628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d902d-d56a-46b2-8182-4d69f0dc2cde admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.605426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d902d-d56a-46b2-8182-4d69f0dc2cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:46.607188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d902d-d56a-46b2-8182-4d69f0dc2cde admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:46.618742 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1201/2390] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:27:46.623544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe58a-1a22-4e7d-9887-d5f2bc8ebb81 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:46.635053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe58a-1a22-4e7d-9887-d5f2bc8ebb81 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:46.640181 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63653e46-faec-4dc4-8680-9cf3f11f3914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:46.640855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653e46-faec-4dc4-8680-9cf3f11f3914 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.641138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653e46-faec-4dc4-8680-9cf3f11f3914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.641414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653e46-faec-4dc4-8680-9cf3f11f3914 admin admin] PATH_INFO: `/v3/projects/311fd588cae2452ba47f7eee97dad4f7/users/d8375c9cd88c4afbaac9fef1b555eb4e/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.663880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63653e46-faec-4dc4-8680-9cf3f11f3914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311fd588cae2452ba47f7eee97dad4f7, user_id=d8375c9cd88c4afbaac9fef1b555eb4e, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:46.667115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63653e46-faec-4dc4-8680-9cf3f11f3914 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:46.691361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1190/2391] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:46 2022] PUT /identity/v3/projects/311fd588cae2452ba47f7eee97dad4f7/users/d8375c9cd88c4afbaac9fef1b555eb4e/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:46.695939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25ab2-95de-4bcb-b537-fe0058bac92f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.696303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25ab2-95de-4bcb-b537-fe0058bac92f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.696581 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25ab2-95de-4bcb-b537-fe0058bac92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.732869 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5dd25ab2-95de-4bcb-b537-fe0058bac92f None None] MFA Rules not processed for user `d8375c9cd88c4afbaac9fef1b555eb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:46.734257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5dd25ab2-95de-4bcb-b537-fe0058bac92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:46.814773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1202/2392] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:46 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:46.820062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63653e46-faec-4dc4-8680-9cf3f11f3914 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:46.825657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:46.891330 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63653e46-faec-4dc4-8680-9cf3f11f3914 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:46.897329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b547b08-a955-46e1-acbf-d7fcc67732cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:46.898318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b547b08-a955-46e1-acbf-d7fcc67732cf admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:46.898689 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b547b08-a955-46e1-acbf-d7fcc67732cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:46.899540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b547b08-a955-46e1-acbf-d7fcc67732cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:46.900567 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b547b08-a955-46e1-acbf-d7fcc67732cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:46.903688 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b547b08-a955-46e1-acbf-d7fcc67732cf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:46.935457 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1191/2393] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:46 2022] POST /identity/v3/projects => generated 407 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:27:46.939402 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd25ab2-95de-4bcb-b537-fe0058bac92f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:46.951024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd25ab2-95de-4bcb-b537-fe0058bac92f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:47.016298 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fe58d-3914-4ce0-a471-63a435235eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:47.017019 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fe58d-3914-4ce0-a471-63a435235eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:47.017372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fe58d-3914-4ce0-a471-63a435235eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:47.017716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fe58d-3914-4ce0-a471-63a435235eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:47.018435 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fe58d-3914-4ce0-a471-63a435235eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:47.020424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fe58d-3914-4ce0-a471-63a435235eb3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:47.045926 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1203/2394] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:46 2022] POST /identity/v3/users => generated 310 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:47.049954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b547b08-a955-46e1-acbf-d7fcc67732cf admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:47.061317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b547b08-a955-46e1-acbf-d7fcc67732cf admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:47.066186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a773f3-58c8-4333-957e-783725904175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:47.067393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a773f3-58c8-4333-957e-783725904175 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:47.067674 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a773f3-58c8-4333-957e-783725904175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:47.067943 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a773f3-58c8-4333-957e-783725904175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:47.068622 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a773f3-58c8-4333-957e-783725904175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:47.070238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a773f3-58c8-4333-957e-783725904175 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:47.082004 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1192/2395] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:47.086474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fe58d-3914-4ce0-a471-63a435235eb3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:47.096894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fe58d-3914-4ce0-a471-63a435235eb3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:47.102499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb2b3-f822-4642-a413-cd90a291aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:47.103490 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb2b3-f822-4642-a413-cd90a291aa62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:47.103776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb2b3-f822-4642-a413-cd90a291aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:47.104133 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb2b3-f822-4642-a413-cd90a291aa62 admin admin] PATH_INFO: `/v3/projects/38f7b182b5b048acb692c41be97bbaca/users/a6239048b7664230a8fbf69f91403750/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:47.121585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb2b3-f822-4642-a413-cd90a291aa62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f7b182b5b048acb692c41be97bbaca, user_id=a6239048b7664230a8fbf69f91403750, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:47.124319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb2b3-f822-4642-a413-cd90a291aa62 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:47.138755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1204/2396] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:47 2022] PUT /identity/v3/projects/38f7b182b5b048acb692c41be97bbaca/users/a6239048b7664230a8fbf69f91403750/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:27:47.142912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a773f3-58c8-4333-957e-783725904175 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:47.153768 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a773f3-58c8-4333-957e-783725904175 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:47.214248 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0743ab-a4fd-486d-a921-2b11cbccfcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:47.214871 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0743ab-a4fd-486d-a921-2b11cbccfcfc admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:47.215157 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0743ab-a4fd-486d-a921-2b11cbccfcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:47.215539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0743ab-a4fd-486d-a921-2b11cbccfcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:47.216378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0743ab-a4fd-486d-a921-2b11cbccfcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:47.217993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0743ab-a4fd-486d-a921-2b11cbccfcfc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:47.229147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1193/2397] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:47.233878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb2b3-f822-4642-a413-cd90a291aa62 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:47.247786 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb2b3-f822-4642-a413-cd90a291aa62 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:47.252570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6aab8-10bf-4f85-84f1-d88878f29a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:47.253258 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6aab8-10bf-4f85-84f1-d88878f29a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:47.253544 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6aab8-10bf-4f85-84f1-d88878f29a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:47.253803 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6aab8-10bf-4f85-84f1-d88878f29a71 admin admin] PATH_INFO: `/v3/projects/38f7b182b5b048acb692c41be97bbaca/users/a6239048b7664230a8fbf69f91403750/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:47.256324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6aab8-10bf-4f85-84f1-d88878f29a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f7b182b5b048acb692c41be97bbaca, user_id=a6239048b7664230a8fbf69f91403750, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:47.258938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6aab8-10bf-4f85-84f1-d88878f29a71 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:47.270415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1205/2398] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:47 2022] PUT /identity/v3/projects/38f7b182b5b048acb692c41be97bbaca/users/a6239048b7664230a8fbf69f91403750/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:47.281987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdf55d-113b-4a3e-8143-53c7e49a8626 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:47.282274 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdf55d-113b-4a3e-8143-53c7e49a8626 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:47.282552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdf55d-113b-4a3e-8143-53c7e49a8626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:47.314257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b7bdf55d-113b-4a3e-8143-53c7e49a8626 None None] MFA Rules not processed for user `a6239048b7664230a8fbf69f91403750`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:47.315499 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b7bdf55d-113b-4a3e-8143-53c7e49a8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:47.392736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:47.401855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1194/2399] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:47 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:47.412646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6aab8-10bf-4f85-84f1-d88878f29a71 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:47.414619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8ad6aab8-10bf-4f85-84f1-d88878f29a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:47.469044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:47.494131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6aab8-10bf-4f85-84f1-d88878f29a71 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:47.498092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c67e64-45b9-401b-b1a2-5e316d53e7ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:47.499068 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c67e64-45b9-401b-b1a2-5e316d53e7ea service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:47.499068 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c67e64-45b9-401b-b1a2-5e316d53e7ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:47.499463 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c67e64-45b9-401b-b1a2-5e316d53e7ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:47.512547 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c67e64-45b9-401b-b1a2-5e316d53e7ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:47.514262 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c67e64-45b9-401b-b1a2-5e316d53e7ea service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:47.536472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1206/2400] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:47 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:47.697553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdf55d-113b-4a3e-8143-53c7e49a8626 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:47.708290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdf55d-113b-4a3e-8143-53c7e49a8626 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:47.711992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe4c43-8195-45ac-ba9f-a18b46a02625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:47.712603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4c43-8195-45ac-ba9f-a18b46a02625 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:47.712880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4c43-8195-45ac-ba9f-a18b46a02625 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:47.713152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4c43-8195-45ac-ba9f-a18b46a02625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:47.775116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe4c43-8195-45ac-ba9f-a18b46a02625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:47.776598 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe4c43-8195-45ac-ba9f-a18b46a02625 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:47.786115 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1195/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:47 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:53.240878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c67e64-45b9-401b-b1a2-5e316d53e7ea service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:53.302652 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c67e64-45b9-401b-b1a2-5e316d53e7ea service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:53.307352 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:53.307958 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:53.308234 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:53.308507 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] PATH_INFO: `/v3/users/d8375c9cd88c4afbaac9fef1b555eb4e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:53.309634 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8375c9cd88c4afbaac9fef1b555eb4e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:53.311612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:53.357585 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8375c9cd88c4afbaac9fef1b555eb4e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:53.358234 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8375c9cd88c4afbaac9fef1b555eb4e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:53.367898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8375c9cd88c4afbaac9fef1b555eb4e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:53.375326 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8375c9cd88c4afbaac9fef1b555eb4e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:53.376117 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8375c9cd88c4afbaac9fef1b555eb4e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:53.393474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1207/2402] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:53 2022] DELETE /identity/v3/users/d8375c9cd88c4afbaac9fef1b555eb4e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:53.398150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a1ec-48e6-4914-91bd-b161bdc287eb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:53.398663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a1ec-48e6-4914-91bd-b161bdc287eb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:53.398663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a1ec-48e6-4914-91bd-b161bdc287eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:53.419038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-65d1a1ec-48e6-4914-91bd-b161bdc287eb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:53.420272 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-65d1a1ec-48e6-4914-91bd-b161bdc287eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:53.480518 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1196/2403] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:27:53.490981 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:53.492484 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:53.548123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fff351-25eb-436d-ab3f-cf038b791422 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:53.552325 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b261f2-3c2f-44ac-8ddf-f0cad7c2d456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:53.552920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b261f2-3c2f-44ac-8ddf-f0cad7c2d456 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:53.553194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b261f2-3c2f-44ac-8ddf-f0cad7c2d456 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:53.553464 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b261f2-3c2f-44ac-8ddf-f0cad7c2d456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:53.562218 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b261f2-3c2f-44ac-8ddf-f0cad7c2d456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:53.563589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b261f2-3c2f-44ac-8ddf-f0cad7c2d456 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:53.568583 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:53.574340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1208/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:53.830937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a1ec-48e6-4914-91bd-b161bdc287eb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:53.833078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-65d1a1ec-48e6-4914-91bd-b161bdc287eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:53.851725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a1ec-48e6-4914-91bd-b161bdc287eb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:53.856552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:53.857183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:53.857462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:53.857757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] PATH_INFO: `/v3/projects/311fd588cae2452ba47f7eee97dad4f7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:53.858840 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=311fd588cae2452ba47f7eee97dad4f7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:53.860769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:53.905593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311fd588cae2452ba47f7eee97dad4f7', 'request_id': 'req-3ccd3550-4787-494b-b803-74a30c477ae9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:53.913149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311fd588cae2452ba47f7eee97dad4f7', 'request_id': 'req-3ccd3550-4787-494b-b803-74a30c477ae9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:53.918902 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311fd588cae2452ba47f7eee97dad4f7', 'request_id': 'req-3ccd3550-4787-494b-b803-74a30c477ae9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:53.929842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] The token cache is being invalidate because project 311fd588cae2452ba47f7eee97dad4f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:53.930130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:53.930764 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:53.932276 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1197/2405] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:53 2022] DELETE /identity/v3/projects/311fd588cae2452ba47f7eee97dad4f7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:53.936378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b261f2-3c2f-44ac-8ddf-f0cad7c2d456 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:53.945941 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b261f2-3c2f-44ac-8ddf-f0cad7c2d456 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:54.001600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:54.002224 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.002499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.002771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] PATH_INFO: `/v3/users/a6239048b7664230a8fbf69f91403750` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.003887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6239048b7664230a8fbf69f91403750)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:54.006355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:54.049045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6239048b7664230a8fbf69f91403750'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:54.049722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6239048b7664230a8fbf69f91403750'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:54.061036 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6239048b7664230a8fbf69f91403750'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:54.068549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6239048b7664230a8fbf69f91403750'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:54.069193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-492045f0-6b23-42c1-b430-b6b28c905dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6239048b7664230a8fbf69f91403750'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:54.086637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1209/2406] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:53 2022] DELETE /identity/v3/users/a6239048b7664230a8fbf69f91403750 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:54.359096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:54.360634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:54.375165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3550-4787-494b-b803-74a30c477ae9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:54.391631 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:54.432116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:54.432761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.433017 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.433290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] PATH_INFO: `/v3/projects/38f7b182b5b048acb692c41be97bbaca` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.434429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f7b182b5b048acb692c41be97bbaca)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:54.436361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:54.481914 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f7b182b5b048acb692c41be97bbaca', 'request_id': 'req-52c7628a-18e6-48ff-b139-e1ede3686354'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:54.488941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f7b182b5b048acb692c41be97bbaca', 'request_id': 'req-52c7628a-18e6-48ff-b139-e1ede3686354'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:54.494514 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f7b182b5b048acb692c41be97bbaca', 'request_id': 'req-52c7628a-18e6-48ff-b139-e1ede3686354'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:54.505783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] The token cache is being invalidate because project 38f7b182b5b048acb692c41be97bbaca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:54.506054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:54.506696 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-52c7628a-18e6-48ff-b139-e1ede3686354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:54.508200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1198/2407] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:54 2022] DELETE /identity/v3/projects/38f7b182b5b048acb692c41be97bbaca => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:54.513009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26f070-3529-4a78-9b04-72c414071726 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.513488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26f070-3529-4a78-9b04-72c414071726 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.513597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26f070-3529-4a78-9b04-72c414071726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.533416 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4b26f070-3529-4a78-9b04-72c414071726 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:54.534626 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4b26f070-3529-4a78-9b04-72c414071726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:54.599726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1210/2408] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:54.607898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85c44-87e3-481b-8066-5e52f65ab898 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.608264 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85c44-87e3-481b-8066-5e52f65ab898 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.608537 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85c44-87e3-481b-8066-5e52f65ab898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.631531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9cc85c44-87e3-481b-8066-5e52f65ab898 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:54.632785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9cc85c44-87e3-481b-8066-5e52f65ab898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:54.640662 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1199/2409] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:54.644952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26f070-3529-4a78-9b04-72c414071726 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:54.654599 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26f070-3529-4a78-9b04-72c414071726 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:54.659146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a14d68-8a5c-46ee-a9aa-4b04dd9e3c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:54.659808 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a14d68-8a5c-46ee-a9aa-4b04dd9e3c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.660202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a14d68-8a5c-46ee-a9aa-4b04dd9e3c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.660390 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a14d68-8a5c-46ee-a9aa-4b04dd9e3c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.661027 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a14d68-8a5c-46ee-a9aa-4b04dd9e3c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:27:54.661348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a14d68-8a5c-46ee-a9aa-4b04dd9e3c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:54.662929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a14d68-8a5c-46ee-a9aa-4b04dd9e3c0a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:54.674251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1211/2410] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:27:54.679026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85c44-87e3-481b-8066-5e52f65ab898 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:54.688217 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85c44-87e3-481b-8066-5e52f65ab898 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:54.693015 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0176b23-f78e-4a9e-b5ad-d978ba8fb578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:54.693612 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0176b23-f78e-4a9e-b5ad-d978ba8fb578 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.693888 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0176b23-f78e-4a9e-b5ad-d978ba8fb578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.694158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0176b23-f78e-4a9e-b5ad-d978ba8fb578 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.694825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0176b23-f78e-4a9e-b5ad-d978ba8fb578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:54.696723 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0176b23-f78e-4a9e-b5ad-d978ba8fb578 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:54.724351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1200/2411] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:54 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:54.728465 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a14d68-8a5c-46ee-a9aa-4b04dd9e3c0a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:54.738253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a14d68-8a5c-46ee-a9aa-4b04dd9e3c0a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:54.741741 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:54.798630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb052e-f058-4022-8d37-25f02ad2018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:54.799243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb052e-f058-4022-8d37-25f02ad2018a admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.799561 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb052e-f058-4022-8d37-25f02ad2018a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.799840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb052e-f058-4022-8d37-25f02ad2018a admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.800472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb052e-f058-4022-8d37-25f02ad2018a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:54.802487 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb052e-f058-4022-8d37-25f02ad2018a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:54.823678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1212/2412] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:54 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:54.827916 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0176b23-f78e-4a9e-b5ad-d978ba8fb578 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:54.838661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0176b23-f78e-4a9e-b5ad-d978ba8fb578 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:54.843245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdc34a-d10d-4a94-815f-b949486e6cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:54.843873 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdc34a-d10d-4a94-815f-b949486e6cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.844149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdc34a-d10d-4a94-815f-b949486e6cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.844419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdc34a-d10d-4a94-815f-b949486e6cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.845050 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdc34a-d10d-4a94-815f-b949486e6cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:54.846623 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdc34a-d10d-4a94-815f-b949486e6cfd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:54.856345 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1201/2413] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:54.860053 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb052e-f058-4022-8d37-25f02ad2018a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:54.870146 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb052e-f058-4022-8d37-25f02ad2018a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:54.874990 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ed71c-4dfc-4cc1-89a9-9499a10bd569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:54.875617 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ed71c-4dfc-4cc1-89a9-9499a10bd569 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.875895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ed71c-4dfc-4cc1-89a9-9499a10bd569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.876165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ed71c-4dfc-4cc1-89a9-9499a10bd569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.876797 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ed71c-4dfc-4cc1-89a9-9499a10bd569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:54.878358 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ed71c-4dfc-4cc1-89a9-9499a10bd569 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:54.889562 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1213/2414] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:27:54.893288 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdc34a-d10d-4a94-815f-b949486e6cfd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:54.903799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdc34a-d10d-4a94-815f-b949486e6cfd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:54.908451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c2b03-3456-4aba-8598-ad684a067f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:54.909094 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c2b03-3456-4aba-8598-ad684a067f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.909373 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c2b03-3456-4aba-8598-ad684a067f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.909645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c2b03-3456-4aba-8598-ad684a067f45 admin admin] PATH_INFO: `/v3/projects/b46238e8a8a142b08e14bccc36d33dd2/users/b114bfe71fb2465ea1b5d216fc46dbbb/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.923984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c2b03-3456-4aba-8598-ad684a067f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46238e8a8a142b08e14bccc36d33dd2, user_id=b114bfe71fb2465ea1b5d216fc46dbbb, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:54.926640 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c2b03-3456-4aba-8598-ad684a067f45 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:54.939759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1202/2415] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:54 2022] PUT /identity/v3/projects/b46238e8a8a142b08e14bccc36d33dd2/users/b114bfe71fb2465ea1b5d216fc46dbbb/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:54.951901 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054c2c-c251-49be-8029-88cecb5d764a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:54.952183 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054c2c-c251-49be-8029-88cecb5d764a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:54.952481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054c2c-c251-49be-8029-88cecb5d764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:54.980401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-60054c2c-c251-49be-8029-88cecb5d764a None None] MFA Rules not processed for user `b114bfe71fb2465ea1b5d216fc46dbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:54.981602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-60054c2c-c251-49be-8029-88cecb5d764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:55.044411 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1214/2416] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:55.048908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c2b03-3456-4aba-8598-ad684a067f45 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:55.099480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:55.115460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c2b03-3456-4aba-8598-ad684a067f45 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:55.120388 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c85254-8411-431a-abc3-c153f9f50a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:55.120993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c85254-8411-431a-abc3-c153f9f50a49 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:55.121275 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c85254-8411-431a-abc3-c153f9f50a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:55.121550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c85254-8411-431a-abc3-c153f9f50a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:55.122188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c85254-8411-431a-abc3-c153f9f50a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:55.124125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c85254-8411-431a-abc3-c153f9f50a49 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:55.149983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1203/2417] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:55 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:55.154138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054c2c-c251-49be-8029-88cecb5d764a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:55.165329 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054c2c-c251-49be-8029-88cecb5d764a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:55.222710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0bd09-80df-46b9-94ce-4848d466b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:55.223848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0bd09-80df-46b9-94ce-4848d466b37c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:55.224124 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0bd09-80df-46b9-94ce-4848d466b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:55.224401 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0bd09-80df-46b9-94ce-4848d466b37c admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:55.225193 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0bd09-80df-46b9-94ce-4848d466b37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:55.227088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0bd09-80df-46b9-94ce-4848d466b37c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:55.248457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1215/2418] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:55 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:27:55.252488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c85254-8411-431a-abc3-c153f9f50a49 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:55.262876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c85254-8411-431a-abc3-c153f9f50a49 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:55.267973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e50b8b-30ca-46ef-8279-43a21f7daee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:55.268798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e50b8b-30ca-46ef-8279-43a21f7daee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:55.269152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e50b8b-30ca-46ef-8279-43a21f7daee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:55.270013 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e50b8b-30ca-46ef-8279-43a21f7daee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:55.270733 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e50b8b-30ca-46ef-8279-43a21f7daee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:55.272540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e50b8b-30ca-46ef-8279-43a21f7daee3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:55.283578 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1204/2419] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:55.288456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0bd09-80df-46b9-94ce-4848d466b37c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:55.295407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:55.299225 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0bd09-80df-46b9-94ce-4848d466b37c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:55.304835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b329f3-384e-497e-ac28-49745fde838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:55.305558 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b329f3-384e-497e-ac28-49745fde838e admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:55.305932 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b329f3-384e-497e-ac28-49745fde838e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:55.306273 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b329f3-384e-497e-ac28-49745fde838e admin admin] PATH_INFO: `/v3/projects/f1d0a9aa28c341d484e58a737276e5fa/users/7f4531849836495a874a5f045ab3eb0c/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:55.321278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b329f3-384e-497e-ac28-49745fde838e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d0a9aa28c341d484e58a737276e5fa, user_id=7f4531849836495a874a5f045ab3eb0c, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:55.324225 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b329f3-384e-497e-ac28-49745fde838e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:55.338938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1216/2420] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:55 2022] PUT /identity/v3/projects/f1d0a9aa28c341d484e58a737276e5fa/users/7f4531849836495a874a5f045ab3eb0c/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:55.343206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e50b8b-30ca-46ef-8279-43a21f7daee3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:55.354736 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e50b8b-30ca-46ef-8279-43a21f7daee3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:55.414393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d184c-7ca2-49dd-9f3a-628c68bd91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:55.415008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d184c-7ca2-49dd-9f3a-628c68bd91a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:55.415343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d184c-7ca2-49dd-9f3a-628c68bd91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:55.415715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d184c-7ca2-49dd-9f3a-628c68bd91a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:55.416254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d184c-7ca2-49dd-9f3a-628c68bd91a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:55.417989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d184c-7ca2-49dd-9f3a-628c68bd91a0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:55.428725 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1205/2421] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:27:55.432893 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b329f3-384e-497e-ac28-49745fde838e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:55.443214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b329f3-384e-497e-ac28-49745fde838e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:55.447924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3eee4a-6d2d-4607-bd6a-d72139aed70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:55.448825 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3eee4a-6d2d-4607-bd6a-d72139aed70c admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:55.449106 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3eee4a-6d2d-4607-bd6a-d72139aed70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:55.449383 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3eee4a-6d2d-4607-bd6a-d72139aed70c admin admin] PATH_INFO: `/v3/projects/f1d0a9aa28c341d484e58a737276e5fa/users/7f4531849836495a874a5f045ab3eb0c/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:55.451311 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3eee4a-6d2d-4607-bd6a-d72139aed70c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d0a9aa28c341d484e58a737276e5fa, user_id=7f4531849836495a874a5f045ab3eb0c, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:55.453936 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3eee4a-6d2d-4607-bd6a-d72139aed70c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:55.464780 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1217/2422] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:55 2022] PUT /identity/v3/projects/f1d0a9aa28c341d484e58a737276e5fa/users/7f4531849836495a874a5f045ab3eb0c/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:27:55.528614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78542ca2-853a-4810-a091-17142a9458cc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:55.529180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78542ca2-853a-4810-a091-17142a9458cc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:55.529180 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78542ca2-853a-4810-a091-17142a9458cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:55.556931 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-78542ca2-853a-4810-a091-17142a9458cc None None] MFA Rules not processed for user `7f4531849836495a874a5f045ab3eb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:55.558126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-78542ca2-853a-4810-a091-17142a9458cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:55.627882 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1206/2423] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:55.639725 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3eee4a-6d2d-4607-bd6a-d72139aed70c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:55.641521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-de3eee4a-6d2d-4607-bd6a-d72139aed70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:55.698488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3eee4a-6d2d-4607-bd6a-d72139aed70c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:55.702135 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1dfd8-f8e9-4ef2-85e8-8c99e6233de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:55.702731 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1dfd8-f8e9-4ef2-85e8-8c99e6233de9 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:55.703008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1dfd8-f8e9-4ef2-85e8-8c99e6233de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:55.703293 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1dfd8-f8e9-4ef2-85e8-8c99e6233de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:55.712865 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1dfd8-f8e9-4ef2-85e8-8c99e6233de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:55.714318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1dfd8-f8e9-4ef2-85e8-8c99e6233de9 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:55.724739 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1218/2424] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:55.822366 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78542ca2-853a-4810-a091-17142a9458cc None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:55.832891 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78542ca2-853a-4810-a091-17142a9458cc None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:55.839085 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bcbc1-545d-49fe-af37-7ab7753d79c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:55.839877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcbc1-545d-49fe-af37-7ab7753d79c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:55.841110 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcbc1-545d-49fe-af37-7ab7753d79c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:55.841389 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcbc1-545d-49fe-af37-7ab7753d79c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:55.890148 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:55.906799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bcbc1-545d-49fe-af37-7ab7753d79c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:55.908253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bcbc1-545d-49fe-af37-7ab7753d79c2 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:55.917515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1207/2425] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:56.177952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1dfd8-f8e9-4ef2-85e8-8c99e6233de9 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:56.238663 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1dfd8-f8e9-4ef2-85e8-8c99e6233de9 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:56.243241 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:56.243912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:56.244198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:56.244499 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] PATH_INFO: `/v3/users/b114bfe71fb2465ea1b5d216fc46dbbb` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:56.245641 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b114bfe71fb2465ea1b5d216fc46dbbb)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:56.247660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:56.292643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b114bfe71fb2465ea1b5d216fc46dbbb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.293278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b114bfe71fb2465ea1b5d216fc46dbbb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.299583 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b114bfe71fb2465ea1b5d216fc46dbbb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.306802 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b114bfe71fb2465ea1b5d216fc46dbbb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.307460 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b114bfe71fb2465ea1b5d216fc46dbbb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.314318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:56.327248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1219/2426] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:56 2022] DELETE /identity/v3/users/b114bfe71fb2465ea1b5d216fc46dbbb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:56.331673 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a058ae2-9305-435c-9108-c4c766a87b98 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:56.331953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a058ae2-9305-435c-9108-c4c766a87b98 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:56.332230 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a058ae2-9305-435c-9108-c4c766a87b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:56.351540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9a058ae2-9305-435c-9108-c4c766a87b98 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:56.352739 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9a058ae2-9305-435c-9108-c4c766a87b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:56.409708 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1208/2427] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:56.419986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:56.421446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:56.477746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ebaf2-6680-472a-80f1-e481d0c637ff admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:56.481391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fdb46-8943-49b2-a228-4885842c07bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:56.481991 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fdb46-8943-49b2-a228-4885842c07bb service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:56.482269 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fdb46-8943-49b2-a228-4885842c07bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:56.482542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fdb46-8943-49b2-a228-4885842c07bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:56.492028 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fdb46-8943-49b2-a228-4885842c07bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:56.493378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fdb46-8943-49b2-a228-4885842c07bb service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:56.502746 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1220/2428] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:56.761263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a058ae2-9305-435c-9108-c4c766a87b98 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:56.762911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9a058ae2-9305-435c-9108-c4c766a87b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:56.777390 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a058ae2-9305-435c-9108-c4c766a87b98 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:56.782520 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:56.783617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:56.783974 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:56.784364 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] PATH_INFO: `/v3/projects/b46238e8a8a142b08e14bccc36d33dd2` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:56.786196 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46238e8a8a142b08e14bccc36d33dd2)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:56.788200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:56.833738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46238e8a8a142b08e14bccc36d33dd2', 'request_id': 'req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.840994 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46238e8a8a142b08e14bccc36d33dd2', 'request_id': 'req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.846920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46238e8a8a142b08e14bccc36d33dd2', 'request_id': 'req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.858272 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] The token cache is being invalidate because project b46238e8a8a142b08e14bccc36d33dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:56.858559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.859173 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.860876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1209/2429] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:56 2022] DELETE /identity/v3/projects/b46238e8a8a142b08e14bccc36d33dd2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:56.865055 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fdb46-8943-49b2-a228-4885842c07bb service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:56.875531 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fdb46-8943-49b2-a228-4885842c07bb service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:56.933734 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:56.934371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:56.934655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:56.934917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] PATH_INFO: `/v3/users/7f4531849836495a874a5f045ab3eb0c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:56.936177 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4531849836495a874a5f045ab3eb0c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:56.938097 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:56.986393 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4531849836495a874a5f045ab3eb0c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.987039 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4531849836495a874a5f045ab3eb0c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:56.994847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4531849836495a874a5f045ab3eb0c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:57.001927 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4531849836495a874a5f045ab3eb0c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:57.002552 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-39044473-27c2-4166-83ad-6cf54fc1c113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4531849836495a874a5f045ab3eb0c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:57.021202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1221/2430] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:27:56 2022] DELETE /identity/v3/users/7f4531849836495a874a5f045ab3eb0c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:57.402512 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:57.404043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:57.421332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8b8a1-f033-45a6-97ec-8e1e87167e1d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:57.486724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:57.487396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:57.487679 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:57.487961 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] PATH_INFO: `/v3/projects/f1d0a9aa28c341d484e58a737276e5fa` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:57.489633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d0a9aa28c341d484e58a737276e5fa)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:57.491572 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:57.498025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:57.538205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d0a9aa28c341d484e58a737276e5fa', 'request_id': 'req-9db3aeaf-80fd-4844-b736-038ce056dd06'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:57.545125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d0a9aa28c341d484e58a737276e5fa', 'request_id': 'req-9db3aeaf-80fd-4844-b736-038ce056dd06'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:57.551140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d0a9aa28c341d484e58a737276e5fa', 'request_id': 'req-9db3aeaf-80fd-4844-b736-038ce056dd06'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:57.562140 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] The token cache is being invalidate because project f1d0a9aa28c341d484e58a737276e5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:27:57.562429 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:57.563053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9db3aeaf-80fd-4844-b736-038ce056dd06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:27:57.564559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1210/2431] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:27:57 2022] DELETE /identity/v3/projects/f1d0a9aa28c341d484e58a737276e5fa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:57.570244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfbc92-f4c1-4697-9f5a-6b5854a236cc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:57.570535 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfbc92-f4c1-4697-9f5a-6b5854a236cc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:57.570814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfbc92-f4c1-4697-9f5a-6b5854a236cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:57.590568 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-66cfbc92-f4c1-4697-9f5a-6b5854a236cc None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:57.591811 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-66cfbc92-f4c1-4697-9f5a-6b5854a236cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:57.597050 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:57.653013 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1222/2432] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:57.660793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e41ee6-6c9c-4ea5-ab00-76e1d1f67b2a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:57.661098 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e41ee6-6c9c-4ea5-ab00-76e1d1f67b2a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:57.661366 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e41ee6-6c9c-4ea5-ab00-76e1d1f67b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:57.681053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-77e41ee6-6c9c-4ea5-ab00-76e1d1f67b2a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:57.682248 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-77e41ee6-6c9c-4ea5-ab00-76e1d1f67b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:57.690061 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1211/2433] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:57.694777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfbc92-f4c1-4697-9f5a-6b5854a236cc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:57.704607 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfbc92-f4c1-4697-9f5a-6b5854a236cc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:57.709165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8432-dc3b-491f-9d73-53456d2ea1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:57.709762 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8432-dc3b-491f-9d73-53456d2ea1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:57.710041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8432-dc3b-491f-9d73-53456d2ea1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:57.710315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8432-dc3b-491f-9d73-53456d2ea1e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:57.710956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb8432-dc3b-491f-9d73-53456d2ea1e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:27:57.711260 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb8432-dc3b-491f-9d73-53456d2ea1e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:57.712865 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb8432-dc3b-491f-9d73-53456d2ea1e4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:57.724127 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1223/2434] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:27:57.728362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e41ee6-6c9c-4ea5-ab00-76e1d1f67b2a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:57.737643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e41ee6-6c9c-4ea5-ab00-76e1d1f67b2a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:57.742929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802de76-4d74-436c-8f57-63a74c63a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:57.743590 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802de76-4d74-436c-8f57-63a74c63a6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:57.743869 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802de76-4d74-436c-8f57-63a74c63a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:57.744139 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802de76-4d74-436c-8f57-63a74c63a6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:57.744774 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802de76-4d74-436c-8f57-63a74c63a6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:57.746644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802de76-4d74-436c-8f57-63a74c63a6c4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:57.773462 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1212/2435] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:27:57 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:27:57.777421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8432-dc3b-491f-9d73-53456d2ea1e4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:57.787155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8432-dc3b-491f-9d73-53456d2ea1e4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:57.843148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ee53e-8ad0-44c8-a1ea-30d472327646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:57.843713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ee53e-8ad0-44c8-a1ea-30d472327646 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:57.844006 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ee53e-8ad0-44c8-a1ea-30d472327646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:57.844263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ee53e-8ad0-44c8-a1ea-30d472327646 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:57.844903 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ee53e-8ad0-44c8-a1ea-30d472327646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:57.846823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ee53e-8ad0-44c8-a1ea-30d472327646 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:57.869631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1224/2436] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:27:57 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:27:57.873937 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802de76-4d74-436c-8f57-63a74c63a6c4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:57.884398 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802de76-4d74-436c-8f57-63a74c63a6c4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:57.890809 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af712beb-e281-423f-97d1-61c796d7ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:57.891474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712beb-e281-423f-97d1-61c796d7ce6d admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:57.891754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712beb-e281-423f-97d1-61c796d7ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:57.892054 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af712beb-e281-423f-97d1-61c796d7ce6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:57.892726 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712beb-e281-423f-97d1-61c796d7ce6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:57.894528 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af712beb-e281-423f-97d1-61c796d7ce6d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:57.905669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1213/2437] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:57.910472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ee53e-8ad0-44c8-a1ea-30d472327646 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:57.920409 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ee53e-8ad0-44c8-a1ea-30d472327646 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:57.925054 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbf958-6b51-4484-8c51-0e07d78edf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:57.926254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf958-6b51-4484-8c51-0e07d78edf98 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:57.926539 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf958-6b51-4484-8c51-0e07d78edf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:57.926811 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf958-6b51-4484-8c51-0e07d78edf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:57.927480 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbf958-6b51-4484-8c51-0e07d78edf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:57.929178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbf958-6b51-4484-8c51-0e07d78edf98 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:57.939805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1225/2438] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:27:57.944074 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af712beb-e281-423f-97d1-61c796d7ce6d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:57.954352 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af712beb-e281-423f-97d1-61c796d7ce6d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:57.959012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7cb92-c836-428b-ad9d-24434e18c552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:57.959695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7cb92-c836-428b-ad9d-24434e18c552 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:57.959976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7cb92-c836-428b-ad9d-24434e18c552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:57.960249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7cb92-c836-428b-ad9d-24434e18c552 admin admin] PATH_INFO: `/v3/projects/60e2033fa1524141802bc48e261670d7/users/1a3dba2a85d54a8f9f6b6d64fb8fec80/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:57.975524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7cb92-c836-428b-ad9d-24434e18c552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e2033fa1524141802bc48e261670d7, user_id=1a3dba2a85d54a8f9f6b6d64fb8fec80, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:57.978175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7cb92-c836-428b-ad9d-24434e18c552 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:57.991836 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1214/2439] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:27:57 2022] PUT /identity/v3/projects/60e2033fa1524141802bc48e261670d7/users/1a3dba2a85d54a8f9f6b6d64fb8fec80/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:27:57.996931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e39d9-3c81-493d-915d-02ceeea4bd79 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:57.997312 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e39d9-3c81-493d-915d-02ceeea4bd79 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:57.997655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e39d9-3c81-493d-915d-02ceeea4bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:58.016716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9c1e39d9-3c81-493d-915d-02ceeea4bd79 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:58.017949 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9c1e39d9-3c81-493d-915d-02ceeea4bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:58.077377 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1226/2440] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:58.087634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7cb92-c836-428b-ad9d-24434e18c552 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:58.089487 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-28f7cb92-c836-428b-ad9d-24434e18c552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:58.148326 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7cb92-c836-428b-ad9d-24434e18c552 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:58.151990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97882bf5-db1f-4580-a53d-99c8c5c952a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:58.152599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97882bf5-db1f-4580-a53d-99c8c5c952a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:58.152874 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97882bf5-db1f-4580-a53d-99c8c5c952a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:58.153146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97882bf5-db1f-4580-a53d-99c8c5c952a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:58.162653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97882bf5-db1f-4580-a53d-99c8c5c952a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:58.164096 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97882bf5-db1f-4580-a53d-99c8c5c952a3 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:58.173633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1215/2441] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:58.783849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c5b27-d120-4990-805f-e112a9e4ba19 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:58.784226 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c5b27-d120-4990-805f-e112a9e4ba19 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:58.784506 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c5b27-d120-4990-805f-e112a9e4ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:58.814232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f68c5b27-d120-4990-805f-e112a9e4ba19 None None] MFA Rules not processed for user `1a3dba2a85d54a8f9f6b6d64fb8fec80`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:58.815633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f68c5b27-d120-4990-805f-e112a9e4ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:58.821656 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:58.888007 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1227/2442] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:58.899453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97882bf5-db1f-4580-a53d-99c8c5c952a3 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:58.900998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-97882bf5-db1f-4580-a53d-99c8c5c952a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:58.937541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:27:58.962466 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97882bf5-db1f-4580-a53d-99c8c5c952a3 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:58.966016 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df858679-c03d-4287-9df4-7c7b58df6f91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:58.966626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df858679-c03d-4287-9df4-7c7b58df6f91 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:58.966906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df858679-c03d-4287-9df4-7c7b58df6f91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:58.967178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df858679-c03d-4287-9df4-7c7b58df6f91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:58.975986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df858679-c03d-4287-9df4-7c7b58df6f91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:58.977620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df858679-c03d-4287-9df4-7c7b58df6f91 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:58.986920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1216/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:27:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:27:59.208968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed12de-13c8-4dfe-a74d-e29cc9b8c515 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:59.209400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed12de-13c8-4dfe-a74d-e29cc9b8c515 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:59.209838 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed12de-13c8-4dfe-a74d-e29cc9b8c515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:59.231215 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-dbed12de-13c8-4dfe-a74d-e29cc9b8c515 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:27:59.232643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dbed12de-13c8-4dfe-a74d-e29cc9b8c515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:59.301176 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1228/2444] 10.222.0.23 () {58 vars in 967 bytes} [Fri Oct 21 21:27:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:27:59.326922 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df858679-c03d-4287-9df4-7c7b58df6f91 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:27:59.339414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-df858679-c03d-4287-9df4-7c7b58df6f91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:27:59.434372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df858679-c03d-4287-9df4-7c7b58df6f91 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:27:59.440401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eedefd-db45-4cd2-8898-f40935e0de08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:27:59.440962 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eedefd-db45-4cd2-8898-f40935e0de08 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:27:59.441758 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eedefd-db45-4cd2-8898-f40935e0de08 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:27:59.442032 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eedefd-db45-4cd2-8898-f40935e0de08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:27:59.451867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eedefd-db45-4cd2-8898-f40935e0de08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:27:59.453915 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eedefd-db45-4cd2-8898-f40935e0de08 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:27:59.464401 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1217/2445] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:27:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:28:00.406842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13be3b-570b-4c17-90bb-55f56048c5b5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:00.407345 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13be3b-570b-4c17-90bb-55f56048c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:00.407472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13be3b-570b-4c17-90bb-55f56048c5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:00.428205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-df13be3b-570b-4c17-90bb-55f56048c5b5 None None] MFA Rules not processed for user `1a3dba2a85d54a8f9f6b6d64fb8fec80`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:28:00.429396 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-df13be3b-570b-4c17-90bb-55f56048c5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:00.436168 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1229/2446] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:28:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:28:08.635657 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eedefd-db45-4cd2-8898-f40935e0de08 service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:28:08.637105 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-36eedefd-db45-4cd2-8898-f40935e0de08 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:08.649128 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eedefd-db45-4cd2-8898-f40935e0de08 service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:28:08.652716 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52042-9f71-481a-a725-608d56f1e0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:28:08.653277 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52042-9f71-481a-a725-608d56f1e0ff service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:08.653603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52042-9f71-481a-a725-608d56f1e0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:08.653826 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52042-9f71-481a-a725-608d56f1e0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:08.655545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fed52042-9f71-481a-a725-608d56f1e0ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:08.667055 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed52042-9f71-481a-a725-608d56f1e0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:28:08.668509 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed52042-9f71-481a-a725-608d56f1e0ff service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:28:08.678441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1218/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:28:10.421449 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=52 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:28:15.254714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13be3b-570b-4c17-90bb-55f56048c5b5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:28:15.256267 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-df13be3b-570b-4c17-90bb-55f56048c5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:15.271961 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13be3b-570b-4c17-90bb-55f56048c5b5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:28:15.277026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:28:15.277879 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:15.278313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:15.278729 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] PATH_INFO: `/v3/users/9a0dff4e7b34477b89c4e429a8c49280` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:15.280077 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0dff4e7b34477b89c4e429a8c49280)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:28:15.282289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:28:15.333151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0dff4e7b34477b89c4e429a8c49280'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.333705 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0dff4e7b34477b89c4e429a8c49280'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.340978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0dff4e7b34477b89c4e429a8c49280'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.349697 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0dff4e7b34477b89c4e429a8c49280'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.350384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0dff4e7b34477b89c4e429a8c49280'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.371816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1230/2448] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:28:15 2022] DELETE /identity/v3/users/9a0dff4e7b34477b89c4e429a8c49280 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:28:15.589948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52042-9f71-481a-a725-608d56f1e0ff service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:28:15.601577 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52042-9f71-481a-a725-608d56f1e0ff service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:28:15.658158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:28:15.658789 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:15.659066 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:15.659897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] PATH_INFO: `/v3/projects/e8cf5b131752420e8df94874b78ae8f3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:15.661009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cf5b131752420e8df94874b78ae8f3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:28:15.662889 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:28:15.708497 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cf5b131752420e8df94874b78ae8f3', 'request_id': 'req-19644139-0b77-4d4c-b81e-5de8ee7082ef'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.712053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:28:15.715968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cf5b131752420e8df94874b78ae8f3', 'request_id': 'req-19644139-0b77-4d4c-b81e-5de8ee7082ef'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.723238 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cf5b131752420e8df94874b78ae8f3', 'request_id': 'req-19644139-0b77-4d4c-b81e-5de8ee7082ef'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.734257 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] The token cache is being invalidate because project e8cf5b131752420e8df94874b78ae8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:28:15.734544 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.735172 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.736678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1219/2449] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:28:15 2022] DELETE /identity/v3/projects/e8cf5b131752420e8df94874b78ae8f3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:28:15.741254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:28:15.742679 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:15.755799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c546f-30fd-4557-9d69-bbe396a50a30 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:28:15.813303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:28:15.813931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:15.814212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:15.814486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] PATH_INFO: `/v3/users/bda6b31c8e9949d98348b9f404262f0c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:15.815695 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda6b31c8e9949d98348b9f404262f0c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:28:15.817617 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:28:15.863975 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda6b31c8e9949d98348b9f404262f0c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.864655 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda6b31c8e9949d98348b9f404262f0c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.872025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda6b31c8e9949d98348b9f404262f0c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.880028 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda6b31c8e9949d98348b9f404262f0c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.880714 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6dfb89b9-ccec-4ad6-b259-f5651180309d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda6b31c8e9949d98348b9f404262f0c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:15.889288 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:28:15.901206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1231/2450] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:28:15 2022] DELETE /identity/v3/users/bda6b31c8e9949d98348b9f404262f0c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:28:16.070214 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:28:16.071701 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:16.085717 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19644139-0b77-4d4c-b81e-5de8ee7082ef admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:28:16.143150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:28:16.144232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:16.144508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:16.144775 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] PATH_INFO: `/v3/projects/5898a12cb4f44a80b6146b57cdad681d` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:16.145883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5898a12cb4f44a80b6146b57cdad681d)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:28:16.147805 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:28:16.192629 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5898a12cb4f44a80b6146b57cdad681d', 'request_id': 'req-10c0432d-cd85-4be6-96ab-bd902d830662'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:16.199929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5898a12cb4f44a80b6146b57cdad681d', 'request_id': 'req-10c0432d-cd85-4be6-96ab-bd902d830662'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:16.205451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5898a12cb4f44a80b6146b57cdad681d', 'request_id': 'req-10c0432d-cd85-4be6-96ab-bd902d830662'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:16.216633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] The token cache is being invalidate because project 5898a12cb4f44a80b6146b57cdad681d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:28:16.216919 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:16.217545 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-10c0432d-cd85-4be6-96ab-bd902d830662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:16.219002 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1220/2451] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:28:16 2022] DELETE /identity/v3/projects/5898a12cb4f44a80b6146b57cdad681d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:28:16.649600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4338c-c82b-42d2-a414-c182f6426207 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:16.650087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4338c-c82b-42d2-a414-c182f6426207 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:16.650205 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4338c-c82b-42d2-a414-c182f6426207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:16.668916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-45c4338c-c82b-42d2-a414-c182f6426207 None None] MFA Rules not processed for user `1a3dba2a85d54a8f9f6b6d64fb8fec80`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:28:16.670109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-45c4338c-c82b-42d2-a414-c182f6426207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:16.725894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1232/2452] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:28:26.213649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:28:26.719239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=28,keystone:DELETE=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:28:31.126144 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65393583-0312-42a0-98be-3cf4ba006741 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:31.126618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65393583-0312-42a0-98be-3cf4ba006741 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:31.126722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65393583-0312-42a0-98be-3cf4ba006741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:31.146919 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-65393583-0312-42a0-98be-3cf4ba006741 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:28:31.148158 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-65393583-0312-42a0-98be-3cf4ba006741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:31.204307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1221/2453] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:28:31.226372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4338c-c82b-42d2-a414-c182f6426207 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:28:31.227799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-45c4338c-c82b-42d2-a414-c182f6426207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:31.297765 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4338c-c82b-42d2-a414-c182f6426207 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:28:31.302589 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071063c-e4b1-42c4-9c43-1a61bce1d018 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:28:31.303198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071063c-e4b1-42c4-9c43-1a61bce1d018 service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:31.303507 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071063c-e4b1-42c4-9c43-1a61bce1d018 service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:31.303784 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071063c-e4b1-42c4-9c43-1a61bce1d018 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:31.311751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071063c-e4b1-42c4-9c43-1a61bce1d018 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:28:31.313313 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071063c-e4b1-42c4-9c43-1a61bce1d018 service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:28:31.321775 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1233/2454] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:28:41.196333 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=25 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:28:41.318615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=32 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:28:46.889561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86099df1-8181-44b6-82b1-7725283076db None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:46.890134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86099df1-8181-44b6-82b1-7725283076db None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:46.890240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86099df1-8181-44b6-82b1-7725283076db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:46.909571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-86099df1-8181-44b6-82b1-7725283076db None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:28:46.910841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-86099df1-8181-44b6-82b1-7725283076db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:46.918174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1222/2455] 10.222.0.23 () {58 vars in 967 bytes} [Fri Oct 21 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:28:46.931839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071063c-e4b1-42c4-9c43-1a61bce1d018 service swift] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:28:46.943216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071063c-e4b1-42c4-9c43-1a61bce1d018 service swift] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:28:46.948845 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c8fc-0b4d-40e1-b9d6-cf35e9e2d38b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:28:46.949491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c8fc-0b4d-40e1-b9d6-cf35e9e2d38b service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:46.949771 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c8fc-0b4d-40e1-b9d6-cf35e9e2d38b service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:46.950044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c8fc-0b4d-40e1-b9d6-cf35e9e2d38b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:46.958350 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58c8fc-0b4d-40e1-b9d6-cf35e9e2d38b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:28:46.959967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58c8fc-0b4d-40e1-b9d6-cf35e9e2d38b service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:28:46.969153 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1234/2456] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:28:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 21 21:28:47.585273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5097b0-37da-42c5-96c4-e6e27dc2ebfb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:47.585561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5097b0-37da-42c5-96c4-e6e27dc2ebfb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:47.585841 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5097b0-37da-42c5-96c4-e6e27dc2ebfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:47.604986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ba5097b0-37da-42c5-96c4-e6e27dc2ebfb None None] MFA Rules not processed for user `86069d1f932640e387038aebb2b1b672`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:28:47.606206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ba5097b0-37da-42c5-96c4-e6e27dc2ebfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:47.661178 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1223/2457] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:28:48.929816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c8fc-0b4d-40e1-b9d6-cf35e9e2d38b service swift] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:28:48.932308 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-cd58c8fc-0b4d-40e1-b9d6-cf35e9e2d38b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:28:49.002413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c8fc-0b4d-40e1-b9d6-cf35e9e2d38b service swift] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:28:49.008272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:28:49.008912 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:49.009195 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:49.009473 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] PATH_INFO: `/v3/users/1a3dba2a85d54a8f9f6b6d64fb8fec80` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:49.010612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3dba2a85d54a8f9f6b6d64fb8fec80)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:28:49.012549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:28:49.061764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3dba2a85d54a8f9f6b6d64fb8fec80'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:49.062418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3dba2a85d54a8f9f6b6d64fb8fec80'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:49.071490 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3dba2a85d54a8f9f6b6d64fb8fec80'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:49.078555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3dba2a85d54a8f9f6b6d64fb8fec80'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:49.079174 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2780d262-7af4-4d09-aed9-5e793a4fc7e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3dba2a85d54a8f9f6b6d64fb8fec80'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:49.095732 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1235/2458] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:28:48 2022] DELETE /identity/v3/users/1a3dba2a85d54a8f9f6b6d64fb8fec80 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:28:49.270368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5097b0-37da-42c5-96c4-e6e27dc2ebfb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:28:49.291647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5097b0-37da-42c5-96c4-e6e27dc2ebfb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:28:49.354738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:28:49.355517 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:28:49.355867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:28:49.356649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] PATH_INFO: `/v3/projects/60e2033fa1524141802bc48e261670d7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:28:49.359255 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e2033fa1524141802bc48e261670d7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:28:49.361709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:28:49.432992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e2033fa1524141802bc48e261670d7', 'request_id': 'req-078793f4-9b83-437c-8ee2-3c4adaf69b57'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:49.441973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e2033fa1524141802bc48e261670d7', 'request_id': 'req-078793f4-9b83-437c-8ee2-3c4adaf69b57'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:49.451149 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e2033fa1524141802bc48e261670d7', 'request_id': 'req-078793f4-9b83-437c-8ee2-3c4adaf69b57'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:49.463492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] The token cache is being invalidate because project 60e2033fa1524141802bc48e261670d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:28:49.463793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:49.464448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:28:49.467338 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1224/2459] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:28:49 2022] DELETE /identity/v3/projects/60e2033fa1524141802bc48e261670d7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:28:59.092272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:28:59.460008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:29:57.470044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f0d7-70be-442c-9d62-0c09c7458c3d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:29:57.470530 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f0d7-70be-442c-9d62-0c09c7458c3d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:29:57.470670 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f0d7-70be-442c-9d62-0c09c7458c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:29:57.510931 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f5a9f0d7-70be-442c-9d62-0c09c7458c3d None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:29:57.512147 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f5a9f0d7-70be-442c-9d62-0c09c7458c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:29:57.594210 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1236/2460] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:29:57.641321 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:29:57.642721 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:29:57.738901 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078793f4-9b83-437c-8ee2-3c4adaf69b57 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:29:57.744706 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33e87f-7994-43d8-98df-5998b6024d54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:29:57.745313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e87f-7994-43d8-98df-5998b6024d54 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:29:57.745589 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e87f-7994-43d8-98df-5998b6024d54 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:29:57.745857 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e87f-7994-43d8-98df-5998b6024d54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:29:57.754077 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33e87f-7994-43d8-98df-5998b6024d54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:29:57.755754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33e87f-7994-43d8-98df-5998b6024d54 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:29:57.764912 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1225/2461] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:29:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:30:06.191341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f0d7-70be-442c-9d62-0c09c7458c3d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:30:06.194049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f5a9f0d7-70be-442c-9d62-0c09c7458c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:30:06.329029 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f0d7-70be-442c-9d62-0c09c7458c3d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:30:06.335586 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8130c-5837-43eb-a9ec-4060cb8ae472 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa89e84c708f44c299c728284e33fabf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:30:06.336282 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8130c-5837-43eb-a9ec-4060cb8ae472 service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:30:06.336628 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8130c-5837-43eb-a9ec-4060cb8ae472 service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:30:06.337009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8130c-5837-43eb-a9ec-4060cb8ae472 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:30:06.342081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d8a8130c-5837-43eb-a9ec-4060cb8ae472 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:30:06.357808 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8130c-5837-43eb-a9ec-4060cb8ae472 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:30:06.361970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8130c-5837-43eb-a9ec-4060cb8ae472 service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:30:06.376621 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1237/2462] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:30:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:30:07.760593 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=43 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:30:13.815596 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65478b-28b8-457c-9484-185e7ad787fb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:30:13.816175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65478b-28b8-457c-9484-185e7ad787fb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:30:13.816175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65478b-28b8-457c-9484-185e7ad787fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:30:13.836024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6a65478b-28b8-457c-9484-185e7ad787fb None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:30:13.837208 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6a65478b-28b8-457c-9484-185e7ad787fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:30:13.844199 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1226/2463] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Oct 21 21:30:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:30:13.856647 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8130c-5837-43eb-a9ec-4060cb8ae472 service placement] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:30:13.868038 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8130c-5837-43eb-a9ec-4060cb8ae472 service placement] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:30:13.873066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951aa53-6387-469a-93f0-c5b7e09b0e2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:30:13.873665 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951aa53-6387-469a-93f0-c5b7e09b0e2b service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:30:13.873943 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951aa53-6387-469a-93f0-c5b7e09b0e2b service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:30:13.874215 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951aa53-6387-469a-93f0-c5b7e09b0e2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:30:13.883748 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951aa53-6387-469a-93f0-c5b7e09b0e2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:30:13.885314 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951aa53-6387-469a-93f0-c5b7e09b0e2b service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:30:13.893481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1238/2464] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:30:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 21 21:30:23.830070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:30:23.890130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:30:29.517489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c56736-3e1d-496b-b21f-43de914e52a6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:30:29.517966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c56736-3e1d-496b-b21f-43de914e52a6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:30:29.518070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c56736-3e1d-496b-b21f-43de914e52a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:30:29.537569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-59c56736-3e1d-496b-b21f-43de914e52a6 None None] MFA Rules not processed for user `0f67502c08b84cee80f57eb194fb731b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:30:29.538754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-59c56736-3e1d-496b-b21f-43de914e52a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:30:29.545853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1227/2465] 10.222.0.23 () {58 vars in 967 bytes} [Fri Oct 21 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:30:29.557948 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951aa53-6387-469a-93f0-c5b7e09b0e2b service swift] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:30:29.568987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951aa53-6387-469a-93f0-c5b7e09b0e2b service swift] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:30:29.574194 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735113-d618-46f0-8c16-56da9d8b82ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dc36f09ae941ecbf30ff11475e7f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:30:29.574783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735113-d618-46f0-8c16-56da9d8b82ef service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:30:29.575056 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735113-d618-46f0-8c16-56da9d8b82ef service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:30:29.575365 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735113-d618-46f0-8c16-56da9d8b82ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:30:29.583728 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71735113-d618-46f0-8c16-56da9d8b82ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:30:29.585271 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71735113-d618-46f0-8c16-56da9d8b82ef service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:30:29.593049 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1239/2466] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Oct 21 21:30:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 21 21:30:39.532753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:30:39.589894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=6 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:04.210617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c56736-3e1d-496b-b21f-43de914e52a6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:04.212120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-59c56736-3e1d-496b-b21f-43de914e52a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:04.291661 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c56736-3e1d-496b-b21f-43de914e52a6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:04.295263 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3631819-0348-4800-811d-ac9d6132a000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:04.295893 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3631819-0348-4800-811d-ac9d6132a000 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:04.296167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3631819-0348-4800-811d-ac9d6132a000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:04.296437 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3631819-0348-4800-811d-ac9d6132a000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:04.298150 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f3631819-0348-4800-811d-ac9d6132a000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:04.385410 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3631819-0348-4800-811d-ac9d6132a000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:04.386858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3631819-0348-4800-811d-ac9d6132a000 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:04.407643 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1228/2467] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:31:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:31:05.591974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735113-d618-46f0-8c16-56da9d8b82ef service swift] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:05.601107 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735113-d618-46f0-8c16-56da9d8b82ef service swift] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:05.604686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90d910-d086-466c-afcd-df2e49c70b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:05.605278 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90d910-d086-466c-afcd-df2e49c70b3a service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:05.605558 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90d910-d086-466c-afcd-df2e49c70b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:05.605854 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90d910-d086-466c-afcd-df2e49c70b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:05.607591 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dd90d910-d086-466c-afcd-df2e49c70b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:05.621081 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90d910-d086-466c-afcd-df2e49c70b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:05.622488 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90d910-d086-466c-afcd-df2e49c70b3a service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:05.633974 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1240/2468] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:31:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:31:13.866205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3631819-0348-4800-811d-ac9d6132a000 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:13.868378 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f3631819-0348-4800-811d-ac9d6132a000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:13.944654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:13.974254 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3631819-0348-4800-811d-ac9d6132a000 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:13.978820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:13.979484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:13.979764 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:13.980038 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] PATH_INFO: `/v3/users/86069d1f932640e387038aebb2b1b672` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:13.981161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86069d1f932640e387038aebb2b1b672)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:13.983059 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:14.028632 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86069d1f932640e387038aebb2b1b672'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:14.036028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86069d1f932640e387038aebb2b1b672'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:14.042968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86069d1f932640e387038aebb2b1b672'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:14.055176 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86069d1f932640e387038aebb2b1b672'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:14.055880 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d4fa913c-7d1c-4e42-935a-aa23f2f945f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86069d1f932640e387038aebb2b1b672'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:14.061832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1229/2469] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:31:13 2022] DELETE /identity/v3/users/86069d1f932640e387038aebb2b1b672 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:14.232647 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90d910-d086-466c-afcd-df2e49c70b3a service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:14.243775 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90d910-d086-466c-afcd-df2e49c70b3a service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:14.302996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:14.303648 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:14.303924 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:14.304219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] PATH_INFO: `/v3/projects/31696281b1f14258b1d88ef3372bc856` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:14.305316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=31696281b1f14258b1d88ef3372bc856)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:14.307191 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:14.352582 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31696281b1f14258b1d88ef3372bc856', 'request_id': 'req-33ab2020-373d-47a4-9c20-867fbf45b42a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:14.358080 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31696281b1f14258b1d88ef3372bc856', 'request_id': 'req-33ab2020-373d-47a4-9c20-867fbf45b42a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:14.365089 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31696281b1f14258b1d88ef3372bc856', 'request_id': 'req-33ab2020-373d-47a4-9c20-867fbf45b42a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:14.377661 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] The token cache is being invalidate because project 31696281b1f14258b1d88ef3372bc856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:31:14.377953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:14.378577 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33ab2020-373d-47a4-9c20-867fbf45b42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:14.380307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1241/2470] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:31:14 2022] DELETE /identity/v3/projects/31696281b1f14258b1d88ef3372bc856 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:14.385039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012143d3-dd13-4cb6-a6cc-d15b0ed333d4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:14.385331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012143d3-dd13-4cb6-a6cc-d15b0ed333d4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:14.385634 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012143d3-dd13-4cb6-a6cc-d15b0ed333d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:14.442402 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-012143d3-dd13-4cb6-a6cc-d15b0ed333d4 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:14.443644 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-012143d3-dd13-4cb6-a6cc-d15b0ed333d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:14.503293 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1230/2471] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:31:14.511285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4339d-9f8e-45f7-86cc-a9b15b0c2b02 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:14.511575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4339d-9f8e-45f7-86cc-a9b15b0c2b02 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:14.511842 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4339d-9f8e-45f7-86cc-a9b15b0c2b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:14.530977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e5a4339d-9f8e-45f7-86cc-a9b15b0c2b02 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:14.532197 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e5a4339d-9f8e-45f7-86cc-a9b15b0c2b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:14.540406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1242/2472] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:31:14.544617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012143d3-dd13-4cb6-a6cc-d15b0ed333d4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:14.554494 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012143d3-dd13-4cb6-a6cc-d15b0ed333d4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:14.559153 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c48afd-b16a-4490-a247-8767e46141c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:14.559770 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c48afd-b16a-4490-a247-8767e46141c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:14.560046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c48afd-b16a-4490-a247-8767e46141c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:14.560314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c48afd-b16a-4490-a247-8767e46141c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:14.560950 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c48afd-b16a-4490-a247-8767e46141c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:31:14.561274 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c48afd-b16a-4490-a247-8767e46141c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:14.562856 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c48afd-b16a-4490-a247-8767e46141c1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:14.574302 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1231/2473] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:31:14.578455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4339d-9f8e-45f7-86cc-a9b15b0c2b02 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:14.588112 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4339d-9f8e-45f7-86cc-a9b15b0c2b02 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:14.592777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e2d3-aedd-437d-8e3b-b88da4c777eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:14.593360 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e2d3-aedd-437d-8e3b-b88da4c777eb admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:14.593636 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e2d3-aedd-437d-8e3b-b88da4c777eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:14.593906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e2d3-aedd-437d-8e3b-b88da4c777eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:14.594536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315e2d3-aedd-437d-8e3b-b88da4c777eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:14.596425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315e2d3-aedd-437d-8e3b-b88da4c777eb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:14.631696 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1243/2474] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:31:14 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:31:14.635825 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c48afd-b16a-4490-a247-8767e46141c1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:14.646145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c48afd-b16a-4490-a247-8767e46141c1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:14.650860 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:14.702346 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d9b2-4161-4245-aabd-adbe7d0efc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:14.702868 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d9b2-4161-4245-aabd-adbe7d0efc1b admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:14.703145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d9b2-4161-4245-aabd-adbe7d0efc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:14.703450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d9b2-4161-4245-aabd-adbe7d0efc1b admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:14.704083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d9b2-4161-4245-aabd-adbe7d0efc1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:14.705973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d9b2-4161-4245-aabd-adbe7d0efc1b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:14.727699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1232/2475] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:31:14 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:31:14.731822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e2d3-aedd-437d-8e3b-b88da4c777eb admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:14.741965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e2d3-aedd-437d-8e3b-b88da4c777eb admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:14.746536 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113eaa5-4d0c-486f-8136-71f7f2f20557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:14.747114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113eaa5-4d0c-486f-8136-71f7f2f20557 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:14.747432 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113eaa5-4d0c-486f-8136-71f7f2f20557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:14.747707 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113eaa5-4d0c-486f-8136-71f7f2f20557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:14.748346 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113eaa5-4d0c-486f-8136-71f7f2f20557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:14.749918 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113eaa5-4d0c-486f-8136-71f7f2f20557 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:14.759652 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1244/2476] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:31:14.763403 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d9b2-4161-4245-aabd-adbe7d0efc1b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:14.774045 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d9b2-4161-4245-aabd-adbe7d0efc1b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:14.778698 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4c5c-62cc-4744-85cc-b8486cd3fab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:14.779319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4c5c-62cc-4744-85cc-b8486cd3fab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:14.779603 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4c5c-62cc-4744-85cc-b8486cd3fab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:14.779879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4c5c-62cc-4744-85cc-b8486cd3fab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:14.780515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b4c5c-62cc-4744-85cc-b8486cd3fab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:14.782097 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b4c5c-62cc-4744-85cc-b8486cd3fab7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:14.792989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1233/2477] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:31:14.797036 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113eaa5-4d0c-486f-8136-71f7f2f20557 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:14.806774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113eaa5-4d0c-486f-8136-71f7f2f20557 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:14.811392 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b5e18-d660-4b39-a1fb-4219316b14f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:14.812032 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b5e18-d660-4b39-a1fb-4219316b14f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:14.812315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b5e18-d660-4b39-a1fb-4219316b14f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:14.812590 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b5e18-d660-4b39-a1fb-4219316b14f7 admin admin] PATH_INFO: `/v3/projects/8ff7fda070454cf28aad2aedd509fdbb/users/ec9d057d0c1d4f01bfa88b4addb3d07b/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:14.827529 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b5e18-d660-4b39-a1fb-4219316b14f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff7fda070454cf28aad2aedd509fdbb, user_id=ec9d057d0c1d4f01bfa88b4addb3d07b, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:14.830159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b5e18-d660-4b39-a1fb-4219316b14f7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:14.843254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1245/2478] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:31:14 2022] PUT /identity/v3/projects/8ff7fda070454cf28aad2aedd509fdbb/users/ec9d057d0c1d4f01bfa88b4addb3d07b/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:31:14.854040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655e130-1c4c-4216-aa53-5dabfe94ba9b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:14.854327 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655e130-1c4c-4216-aa53-5dabfe94ba9b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:14.854615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655e130-1c4c-4216-aa53-5dabfe94ba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:14.882074 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c655e130-1c4c-4216-aa53-5dabfe94ba9b None None] MFA Rules not processed for user `ec9d057d0c1d4f01bfa88b4addb3d07b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:14.883299 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c655e130-1c4c-4216-aa53-5dabfe94ba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:14.947867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1234/2479] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:31:14.959570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b5e18-d660-4b39-a1fb-4219316b14f7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:14.961206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e10b5e18-d660-4b39-a1fb-4219316b14f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:14.967675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:15.036243 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b5e18-d660-4b39-a1fb-4219316b14f7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:15.041801 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b960f-0238-4cc0-9cf9-9df91335baf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8afe54a4c63b4a50a6240293e2be6450', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:15.042406 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b960f-0238-4cc0-9cf9-9df91335baf9 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:15.042691 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b960f-0238-4cc0-9cf9-9df91335baf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:15.042968 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b960f-0238-4cc0-9cf9-9df91335baf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:15.050983 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b960f-0238-4cc0-9cf9-9df91335baf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:15.052627 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b960f-0238-4cc0-9cf9-9df91335baf9 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:15.061874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1246/2480] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:31:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:31:20.235681 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655e130-1c4c-4216-aa53-5dabfe94ba9b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:20.294404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655e130-1c4c-4216-aa53-5dabfe94ba9b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:20.298879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:20.299531 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:20.299811 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:20.300083 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] PATH_INFO: `/v3/users/ec9d057d0c1d4f01bfa88b4addb3d07b` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:20.301213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9d057d0c1d4f01bfa88b4addb3d07b)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:20.303507 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:20.325614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:20.350883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9d057d0c1d4f01bfa88b4addb3d07b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:20.357559 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9d057d0c1d4f01bfa88b4addb3d07b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:20.364713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9d057d0c1d4f01bfa88b4addb3d07b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:20.376323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9d057d0c1d4f01bfa88b4addb3d07b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:20.376947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9d057d0c1d4f01bfa88b4addb3d07b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:20.383146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1235/2481] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:31:20 2022] DELETE /identity/v3/users/ec9d057d0c1d4f01bfa88b4addb3d07b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:20.387601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8639e9-f6b7-4516-b1db-e99197a2a1ab None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:20.388087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8639e9-f6b7-4516-b1db-e99197a2a1ab None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:20.388192 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8639e9-f6b7-4516-b1db-e99197a2a1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:20.407082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6d8639e9-f6b7-4516-b1db-e99197a2a1ab None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:20.408296 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6d8639e9-f6b7-4516-b1db-e99197a2a1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:20.464764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1247/2482] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:31:20.474705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:20.476161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:20.532047 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c1f15-50dd-4331-ba86-64415aad6a0b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:20.535714 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e025e-356f-4a56-8a36-19e5bcba0044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:20.536314 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e025e-356f-4a56-8a36-19e5bcba0044 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:20.536592 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e025e-356f-4a56-8a36-19e5bcba0044 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:20.536864 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e025e-356f-4a56-8a36-19e5bcba0044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:20.545642 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e025e-356f-4a56-8a36-19e5bcba0044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:20.547051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e025e-356f-4a56-8a36-19e5bcba0044 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:20.556363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1236/2483] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:31:20.818212 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8639e9-f6b7-4516-b1db-e99197a2a1ab None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:20.819660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6d8639e9-f6b7-4516-b1db-e99197a2a1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:20.833427 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8639e9-f6b7-4516-b1db-e99197a2a1ab None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:20.838731 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:20.839426 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:20.839735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:20.840073 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] PATH_INFO: `/v3/projects/8ff7fda070454cf28aad2aedd509fdbb` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:20.841084 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff7fda070454cf28aad2aedd509fdbb)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:20.842963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:20.891993 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff7fda070454cf28aad2aedd509fdbb', 'request_id': 'req-127f8ce6-98ab-404c-a64e-d2ea64087b12'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:20.897610 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff7fda070454cf28aad2aedd509fdbb', 'request_id': 'req-127f8ce6-98ab-404c-a64e-d2ea64087b12'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:20.903868 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff7fda070454cf28aad2aedd509fdbb', 'request_id': 'req-127f8ce6-98ab-404c-a64e-d2ea64087b12'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:20.916189 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] The token cache is being invalidate because project 8ff7fda070454cf28aad2aedd509fdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:31:20.916483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:20.917108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-127f8ce6-98ab-404c-a64e-d2ea64087b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:20.918588 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1248/2484] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:31:20 2022] DELETE /identity/v3/projects/8ff7fda070454cf28aad2aedd509fdbb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:20.923654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b53b1d-f513-44a4-8abf-f8412d6c8b8a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:20.924014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b53b1d-f513-44a4-8abf-f8412d6c8b8a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:20.924292 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b53b1d-f513-44a4-8abf-f8412d6c8b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:20.944638 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-97b53b1d-f513-44a4-8abf-f8412d6c8b8a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:20.945827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-97b53b1d-f513-44a4-8abf-f8412d6c8b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:21.003621 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1237/2485] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:31:21.011152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a3f1-3f9d-4799-ae7e-b6ec9aacc439 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.011471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a3f1-3f9d-4799-ae7e-b6ec9aacc439 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.011754 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a3f1-3f9d-4799-ae7e-b6ec9aacc439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.030866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-efc8a3f1-3f9d-4799-ae7e-b6ec9aacc439 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:21.032128 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-efc8a3f1-3f9d-4799-ae7e-b6ec9aacc439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:21.040378 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1249/2486] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:31:21.044480 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b53b1d-f513-44a4-8abf-f8412d6c8b8a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.054968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b53b1d-f513-44a4-8abf-f8412d6c8b8a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.060508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b63faa-9cda-4325-a123-6477071ffd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.061125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b63faa-9cda-4325-a123-6477071ffd36 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.061405 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b63faa-9cda-4325-a123-6477071ffd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.061675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b63faa-9cda-4325-a123-6477071ffd36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.062317 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b63faa-9cda-4325-a123-6477071ffd36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:31:21.062615 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b63faa-9cda-4325-a123-6477071ffd36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.064283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b63faa-9cda-4325-a123-6477071ffd36 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.076472 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1238/2487] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:31:21.080889 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8a3f1-3f9d-4799-ae7e-b6ec9aacc439 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.092105 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8a3f1-3f9d-4799-ae7e-b6ec9aacc439 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.097384 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd6d18-35a3-41cb-93d7-cf5c337c3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.097987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd6d18-35a3-41cb-93d7-cf5c337c3001 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.098266 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd6d18-35a3-41cb-93d7-cf5c337c3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.098553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd6d18-35a3-41cb-93d7-cf5c337c3001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.099172 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd6d18-35a3-41cb-93d7-cf5c337c3001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.101091 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd6d18-35a3-41cb-93d7-cf5c337c3001 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.105600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:21.131010 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1250/2488] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:31:21 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:31:21.135231 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b63faa-9cda-4325-a123-6477071ffd36 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.144973 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b63faa-9cda-4325-a123-6477071ffd36 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.169600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:21.202831 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5bcd-fd8a-44aa-aa6b-29973676f1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.203477 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5bcd-fd8a-44aa-aa6b-29973676f1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.203759 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5bcd-fd8a-44aa-aa6b-29973676f1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.204033 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5bcd-fd8a-44aa-aa6b-29973676f1a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.204653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df5bcd-fd8a-44aa-aa6b-29973676f1a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.206612 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df5bcd-fd8a-44aa-aa6b-29973676f1a7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.227273 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1239/2489] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:31:21 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:31:21.231553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd6d18-35a3-41cb-93d7-cf5c337c3001 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.242244 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd6d18-35a3-41cb-93d7-cf5c337c3001 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.246832 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166b0d1-70a3-4d92-b19a-2bd467346015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.247458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b0d1-70a3-4d92-b19a-2bd467346015 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.247736 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b0d1-70a3-4d92-b19a-2bd467346015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.248009 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b0d1-70a3-4d92-b19a-2bd467346015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.248640 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166b0d1-70a3-4d92-b19a-2bd467346015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.250199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166b0d1-70a3-4d92-b19a-2bd467346015 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.259823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1251/2490] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:31:21.263527 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5bcd-fd8a-44aa-aa6b-29973676f1a7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.273552 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5bcd-fd8a-44aa-aa6b-29973676f1a7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.278209 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d28bd1-a18e-453e-a2a1-dd709f25dd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.278829 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d28bd1-a18e-453e-a2a1-dd709f25dd95 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.279116 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d28bd1-a18e-453e-a2a1-dd709f25dd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.279416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d28bd1-a18e-453e-a2a1-dd709f25dd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.280048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d28bd1-a18e-453e-a2a1-dd709f25dd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.281616 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d28bd1-a18e-453e-a2a1-dd709f25dd95 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.292824 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1240/2491] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:31:21.296890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166b0d1-70a3-4d92-b19a-2bd467346015 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.307680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166b0d1-70a3-4d92-b19a-2bd467346015 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.312376 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca960c-5a0f-40d9-bbcf-270ec7fa5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.313034 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca960c-5a0f-40d9-bbcf-270ec7fa5695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.313315 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca960c-5a0f-40d9-bbcf-270ec7fa5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.313592 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca960c-5a0f-40d9-bbcf-270ec7fa5695 admin admin] PATH_INFO: `/v3/projects/c9721800c7c3446897da03240d3e7ffb/users/26184d7244a34eca9cf9ee8a8542ea15/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.329272 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca960c-5a0f-40d9-bbcf-270ec7fa5695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9721800c7c3446897da03240d3e7ffb, user_id=26184d7244a34eca9cf9ee8a8542ea15, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.332451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca960c-5a0f-40d9-bbcf-270ec7fa5695 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.351469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1252/2492] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:31:21 2022] PUT /identity/v3/projects/c9721800c7c3446897da03240d3e7ffb/users/26184d7244a34eca9cf9ee8a8542ea15/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:21.356614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e6e0-5f4a-41e6-b7fa-b5db8dde7112 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.356898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e6e0-5f4a-41e6-b7fa-b5db8dde7112 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.357173 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e6e0-5f4a-41e6-b7fa-b5db8dde7112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.385955 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5ba8e6e0-5f4a-41e6-b7fa-b5db8dde7112 None None] MFA Rules not processed for user `26184d7244a34eca9cf9ee8a8542ea15`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:21.387162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5ba8e6e0-5f4a-41e6-b7fa-b5db8dde7112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:21.449649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1241/2493] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:31:21.454090 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca960c-5a0f-40d9-bbcf-270ec7fa5695 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.514455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca960c-5a0f-40d9-bbcf-270ec7fa5695 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.519616 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1480e2-76c7-424a-b40c-231b8fbd268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.520213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1480e2-76c7-424a-b40c-231b8fbd268f admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.520493 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1480e2-76c7-424a-b40c-231b8fbd268f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.520766 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1480e2-76c7-424a-b40c-231b8fbd268f admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.521430 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1480e2-76c7-424a-b40c-231b8fbd268f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.523322 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1480e2-76c7-424a-b40c-231b8fbd268f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.549303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1253/2494] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:31:21 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:31:21.553538 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e6e0-5f4a-41e6-b7fa-b5db8dde7112 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.564053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e6e0-5f4a-41e6-b7fa-b5db8dde7112 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.619626 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c1c5-38ba-41af-8097-74ce45e3c818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.620228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c1c5-38ba-41af-8097-74ce45e3c818 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.620508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c1c5-38ba-41af-8097-74ce45e3c818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.620780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c1c5-38ba-41af-8097-74ce45e3c818 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.621410 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5c1c5-38ba-41af-8097-74ce45e3c818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.623318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5c1c5-38ba-41af-8097-74ce45e3c818 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.644360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1242/2495] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:31:21 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:31:21.648414 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1480e2-76c7-424a-b40c-231b8fbd268f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.658468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1480e2-76c7-424a-b40c-231b8fbd268f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.663891 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a51ce-484b-4e5f-a677-6327f33ef1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.664494 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a51ce-484b-4e5f-a677-6327f33ef1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.664769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a51ce-484b-4e5f-a677-6327f33ef1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.665038 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a51ce-484b-4e5f-a677-6327f33ef1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.665692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a51ce-484b-4e5f-a677-6327f33ef1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.667680 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a51ce-484b-4e5f-a677-6327f33ef1c1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.678276 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1254/2496] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:31:21.682424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c1c5-38ba-41af-8097-74ce45e3c818 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.692628 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c1c5-38ba-41af-8097-74ce45e3c818 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.697414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcab3d2-bd08-4aa8-93f6-46585ffc78c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.698060 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcab3d2-bd08-4aa8-93f6-46585ffc78c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.698335 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcab3d2-bd08-4aa8-93f6-46585ffc78c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.698606 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcab3d2-bd08-4aa8-93f6-46585ffc78c4 admin admin] PATH_INFO: `/v3/projects/9cc30b0f82194a69a25172e1068119f5/users/4924c3f29bb34faf8cf6a0543f4c925d/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.713279 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcab3d2-bd08-4aa8-93f6-46585ffc78c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc30b0f82194a69a25172e1068119f5, user_id=4924c3f29bb34faf8cf6a0543f4c925d, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.715890 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcab3d2-bd08-4aa8-93f6-46585ffc78c4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.724854 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:21.729746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1243/2497] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:31:21 2022] PUT /identity/v3/projects/9cc30b0f82194a69a25172e1068119f5/users/4924c3f29bb34faf8cf6a0543f4c925d/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:21.733989 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a51ce-484b-4e5f-a677-6327f33ef1c1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.743720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a51ce-484b-4e5f-a677-6327f33ef1c1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.799213 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbc68d-299b-4bc7-8e74-ef5b501113b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.799866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbc68d-299b-4bc7-8e74-ef5b501113b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.800145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbc68d-299b-4bc7-8e74-ef5b501113b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.800415 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbc68d-299b-4bc7-8e74-ef5b501113b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.801043 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbc68d-299b-4bc7-8e74-ef5b501113b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.802615 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbc68d-299b-4bc7-8e74-ef5b501113b8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.811982 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1255/2498] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:31:21.816686 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcab3d2-bd08-4aa8-93f6-46585ffc78c4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.827042 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcab3d2-bd08-4aa8-93f6-46585ffc78c4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:21.832152 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cdcd3-e261-4547-a8bf-9f2530d9ee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:21.832792 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cdcd3-e261-4547-a8bf-9f2530d9ee07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.833065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cdcd3-e261-4547-a8bf-9f2530d9ee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.833332 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cdcd3-e261-4547-a8bf-9f2530d9ee07 admin admin] PATH_INFO: `/v3/projects/9cc30b0f82194a69a25172e1068119f5/users/4924c3f29bb34faf8cf6a0543f4c925d/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.835413 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cdcd3-e261-4547-a8bf-9f2530d9ee07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc30b0f82194a69a25172e1068119f5, user_id=4924c3f29bb34faf8cf6a0543f4c925d, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:21.837999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cdcd3-e261-4547-a8bf-9f2530d9ee07 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:21.848503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1244/2499] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:31:21 2022] PUT /identity/v3/projects/9cc30b0f82194a69a25172e1068119f5/users/4924c3f29bb34faf8cf6a0543f4c925d/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:21.859782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dbc27-6d50-4f22-aae9-13c17f79046d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:21.860069 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dbc27-6d50-4f22-aae9-13c17f79046d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:21.860344 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dbc27-6d50-4f22-aae9-13c17f79046d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:21.888318 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-861dbc27-6d50-4f22-aae9-13c17f79046d None None] MFA Rules not processed for user `4924c3f29bb34faf8cf6a0543f4c925d`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:21.889508 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-861dbc27-6d50-4f22-aae9-13c17f79046d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:21.897503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:21.957088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1256/2500] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:31:21.968344 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cdcd3-e261-4547-a8bf-9f2530d9ee07 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:21.969979 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e54cdcd3-e261-4547-a8bf-9f2530d9ee07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:22.047388 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cdcd3-e261-4547-a8bf-9f2530d9ee07 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:22.051089 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e2c0-6e4b-47d8-8e17-b5a41d6f71d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:22.051727 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e2c0-6e4b-47d8-8e17-b5a41d6f71d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:22.052012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e2c0-6e4b-47d8-8e17-b5a41d6f71d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:22.052290 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40e2c0-6e4b-47d8-8e17-b5a41d6f71d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:22.062408 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40e2c0-6e4b-47d8-8e17-b5a41d6f71d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:22.063887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40e2c0-6e4b-47d8-8e17-b5a41d6f71d3 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:22.074245 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1245/2501] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:31:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:31:22.148169 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dbc27-6d50-4f22-aae9-13c17f79046d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:22.157708 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dbc27-6d50-4f22-aae9-13c17f79046d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:22.161362 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28f86d-de09-4e55-906f-2f0eb3a37e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:22.161996 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28f86d-de09-4e55-906f-2f0eb3a37e9f service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:22.162276 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28f86d-de09-4e55-906f-2f0eb3a37e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:22.162551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28f86d-de09-4e55-906f-2f0eb3a37e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:22.219227 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28f86d-de09-4e55-906f-2f0eb3a37e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:22.220614 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28f86d-de09-4e55-906f-2f0eb3a37e9f service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:22.229423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1257/2502] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:31:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:31:32.069738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:32.225355 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=53 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:51.142465 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e2c0-6e4b-47d8-8e17-b5a41d6f71d3 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:51.203489 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40e2c0-6e4b-47d8-8e17-b5a41d6f71d3 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:51.208596 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:51.209213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:51.209488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:51.209757 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] PATH_INFO: `/v3/users/26184d7244a34eca9cf9ee8a8542ea15` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:51.210852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26184d7244a34eca9cf9ee8a8542ea15)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:51.212773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:51.256300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26184d7244a34eca9cf9ee8a8542ea15'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.262989 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26184d7244a34eca9cf9ee8a8542ea15'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.270418 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26184d7244a34eca9cf9ee8a8542ea15'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.281953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26184d7244a34eca9cf9ee8a8542ea15'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.282580 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26184d7244a34eca9cf9ee8a8542ea15'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.288356 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1246/2503] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:31:51 2022] DELETE /identity/v3/users/26184d7244a34eca9cf9ee8a8542ea15 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:51.292848 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027767-c51e-4d4b-9de8-0b884f36832c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:51.293356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027767-c51e-4d4b-9de8-0b884f36832c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:51.293456 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027767-c51e-4d4b-9de8-0b884f36832c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:51.312521 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9a027767-c51e-4d4b-9de8-0b884f36832c None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:51.313710 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9a027767-c51e-4d4b-9de8-0b884f36832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:51.371608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1258/2504] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:31:51.381984 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:51.383436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:51.438581 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53863e4-70b6-403d-8813-30ead91d6940 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:51.442771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670a644-3d18-41b2-bf77-064ab766cc02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:51.443400 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670a644-3d18-41b2-bf77-064ab766cc02 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:51.443695 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670a644-3d18-41b2-bf77-064ab766cc02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:51.443948 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670a644-3d18-41b2-bf77-064ab766cc02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:51.453151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670a644-3d18-41b2-bf77-064ab766cc02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:51.454557 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670a644-3d18-41b2-bf77-064ab766cc02 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:51.463798 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1247/2505] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:31:51.726356 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a027767-c51e-4d4b-9de8-0b884f36832c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:51.727880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9a027767-c51e-4d4b-9de8-0b884f36832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:51.740877 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a027767-c51e-4d4b-9de8-0b884f36832c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:51.745701 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:51.746413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:51.746760 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:51.747118 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] PATH_INFO: `/v3/projects/c9721800c7c3446897da03240d3e7ffb` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:51.748352 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9721800c7c3446897da03240d3e7ffb)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:51.750334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:51.796254 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9721800c7c3446897da03240d3e7ffb', 'request_id': 'req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.802987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9721800c7c3446897da03240d3e7ffb', 'request_id': 'req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.809365 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9721800c7c3446897da03240d3e7ffb', 'request_id': 'req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.821863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] The token cache is being invalidate because project c9721800c7c3446897da03240d3e7ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:31:51.822150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.822773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.824283 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1259/2506] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:31:51 2022] DELETE /identity/v3/projects/c9721800c7c3446897da03240d3e7ffb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:31:51.828249 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670a644-3d18-41b2-bf77-064ab766cc02 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:51.837805 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670a644-3d18-41b2-bf77-064ab766cc02 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:51.855748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:51.895877 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:51.896511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:51.896794 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:51.897068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] PATH_INFO: `/v3/users/4924c3f29bb34faf8cf6a0543f4c925d` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:51.898233 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4924c3f29bb34faf8cf6a0543f4c925d)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:51.900204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:51.944929 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4924c3f29bb34faf8cf6a0543f4c925d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.951966 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4924c3f29bb34faf8cf6a0543f4c925d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.958926 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4924c3f29bb34faf8cf6a0543f4c925d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.970722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4924c3f29bb34faf8cf6a0543f4c925d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.971372 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ca2ae688-7cc7-4f34-86b9-dc9110b12108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4924c3f29bb34faf8cf6a0543f4c925d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:51.977549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1248/2507] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:31:51 2022] DELETE /identity/v3/users/4924c3f29bb34faf8cf6a0543f4c925d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:52.238391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:52.239878 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:52.253778 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089ad4a-b106-4516-8d0f-4a7d754f8dbe admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:52.310505 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:52.311132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:52.311395 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:52.311675 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] PATH_INFO: `/v3/projects/9cc30b0f82194a69a25172e1068119f5` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:52.312794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc30b0f82194a69a25172e1068119f5)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:52.314687 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:52.344509 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:52.362305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc30b0f82194a69a25172e1068119f5', 'request_id': 'req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:52.367814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc30b0f82194a69a25172e1068119f5', 'request_id': 'req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:52.373776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc30b0f82194a69a25172e1068119f5', 'request_id': 'req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:52.387895 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] The token cache is being invalidate because project 9cc30b0f82194a69a25172e1068119f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:31:52.388188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:52.388824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-77fc4bcb-fa0f-4b65-ae95-12bcc909f693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:31:52.390331 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1260/2508] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:31:52 2022] DELETE /identity/v3/projects/9cc30b0f82194a69a25172e1068119f5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:52.395954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ea34-65a4-4ce2-8b6c-316ef6c462fb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:52.396438 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ea34-65a4-4ce2-8b6c-316ef6c462fb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:52.396540 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ea34-65a4-4ce2-8b6c-316ef6c462fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:52.416561 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-aa17ea34-65a4-4ce2-8b6c-316ef6c462fb None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:52.417745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-aa17ea34-65a4-4ce2-8b6c-316ef6c462fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:52.475767 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1249/2509] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:31:52.483683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa9bf3-eacf-434c-a2c0-0b487dc224db None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:52.483969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa9bf3-eacf-434c-a2c0-0b487dc224db None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:52.484240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa9bf3-eacf-434c-a2c0-0b487dc224db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:52.504969 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-97aa9bf3-eacf-434c-a2c0-0b487dc224db None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:52.506182 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-97aa9bf3-eacf-434c-a2c0-0b487dc224db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:52.513823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1261/2510] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:31:52.518039 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ea34-65a4-4ce2-8b6c-316ef6c462fb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:52.529393 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ea34-65a4-4ce2-8b6c-316ef6c462fb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:52.533922 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf450b-2aec-49ad-83de-a7a161cc1166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:52.534571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf450b-2aec-49ad-83de-a7a161cc1166 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:52.534866 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf450b-2aec-49ad-83de-a7a161cc1166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:52.535114 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf450b-2aec-49ad-83de-a7a161cc1166 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:52.535778 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf450b-2aec-49ad-83de-a7a161cc1166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:31:52.536075 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf450b-2aec-49ad-83de-a7a161cc1166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:52.537646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf450b-2aec-49ad-83de-a7a161cc1166 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:52.549302 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1250/2511] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:31:52.553602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa9bf3-eacf-434c-a2c0-0b487dc224db None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:52.562681 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa9bf3-eacf-434c-a2c0-0b487dc224db None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:52.567684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c374a7-a83b-48c5-8ee1-8b9940337a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:52.568274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c374a7-a83b-48c5-8ee1-8b9940337a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:52.568550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c374a7-a83b-48c5-8ee1-8b9940337a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:52.568823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c374a7-a83b-48c5-8ee1-8b9940337a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:52.569445 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c374a7-a83b-48c5-8ee1-8b9940337a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:52.571594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c374a7-a83b-48c5-8ee1-8b9940337a8f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:52.598114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1262/2512] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:31:52 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:31:52.602405 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf450b-2aec-49ad-83de-a7a161cc1166 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:52.612387 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf450b-2aec-49ad-83de-a7a161cc1166 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:52.637761 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:52.669200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d021abb-ccf3-42b9-8b5c-ea42cc35642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:52.669793 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d021abb-ccf3-42b9-8b5c-ea42cc35642a admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:52.670065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d021abb-ccf3-42b9-8b5c-ea42cc35642a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:52.670331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d021abb-ccf3-42b9-8b5c-ea42cc35642a admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:52.670954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d021abb-ccf3-42b9-8b5c-ea42cc35642a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:52.672868 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d021abb-ccf3-42b9-8b5c-ea42cc35642a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:52.693550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1251/2513] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:31:52 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:31:52.698138 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c374a7-a83b-48c5-8ee1-8b9940337a8f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:52.709021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c374a7-a83b-48c5-8ee1-8b9940337a8f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:52.713654 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76382b62-d057-4075-822e-e6d09160e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:52.714253 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76382b62-d057-4075-822e-e6d09160e636 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:52.714532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76382b62-d057-4075-822e-e6d09160e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:52.714805 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76382b62-d057-4075-822e-e6d09160e636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:52.715608 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76382b62-d057-4075-822e-e6d09160e636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:52.717188 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76382b62-d057-4075-822e-e6d09160e636 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:52.727549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1263/2514] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:31:52.731383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d021abb-ccf3-42b9-8b5c-ea42cc35642a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:52.741125 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d021abb-ccf3-42b9-8b5c-ea42cc35642a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:52.745687 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07655f59-1d91-41d0-b669-ef0cd7dbc2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:52.746279 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655f59-1d91-41d0-b669-ef0cd7dbc2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:52.746555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655f59-1d91-41d0-b669-ef0cd7dbc2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:52.746827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655f59-1d91-41d0-b669-ef0cd7dbc2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:52.747481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07655f59-1d91-41d0-b669-ef0cd7dbc2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:52.749048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07655f59-1d91-41d0-b669-ef0cd7dbc2e7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:52.759930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1252/2515] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:31:52.763777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76382b62-d057-4075-822e-e6d09160e636 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:52.774209 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76382b62-d057-4075-822e-e6d09160e636 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:52.779063 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfac4b0-d8cc-46a4-bbc4-b80417eb0418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:52.779768 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfac4b0-d8cc-46a4-bbc4-b80417eb0418 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:52.780048 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfac4b0-d8cc-46a4-bbc4-b80417eb0418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:52.780321 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfac4b0-d8cc-46a4-bbc4-b80417eb0418 admin admin] PATH_INFO: `/v3/projects/0c604ebeb6f0498d90130c558fd92c13/users/cdcfe5327de744aea9f47a2f2bb5fb12/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:52.794672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfac4b0-d8cc-46a4-bbc4-b80417eb0418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c604ebeb6f0498d90130c558fd92c13, user_id=cdcfe5327de744aea9f47a2f2bb5fb12, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:52.797354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfac4b0-d8cc-46a4-bbc4-b80417eb0418 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:52.809660 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1264/2516] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:31:52 2022] PUT /identity/v3/projects/0c604ebeb6f0498d90130c558fd92c13/users/cdcfe5327de744aea9f47a2f2bb5fb12/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:52.872508 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435426f-a709-440e-9140-db73b1af1fe9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:52.872735 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435426f-a709-440e-9140-db73b1af1fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:52.872964 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435426f-a709-440e-9140-db73b1af1fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:52.901118 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b435426f-a709-440e-9140-db73b1af1fe9 None None] MFA Rules not processed for user `cdcfe5327de744aea9f47a2f2bb5fb12`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:52.902328 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b435426f-a709-440e-9140-db73b1af1fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:52.964113 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1253/2517] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:31:52.968601 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfac4b0-d8cc-46a4-bbc4-b80417eb0418 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:53.029150 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfac4b0-d8cc-46a4-bbc4-b80417eb0418 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:53.033769 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e1a2-8334-48e8-a860-a54ebbbd3ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:53.034397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e1a2-8334-48e8-a860-a54ebbbd3ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:53.034679 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e1a2-8334-48e8-a860-a54ebbbd3ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:53.034953 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e1a2-8334-48e8-a860-a54ebbbd3ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:53.035612 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9e1a2-8334-48e8-a860-a54ebbbd3ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:53.037496 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9e1a2-8334-48e8-a860-a54ebbbd3ee5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:53.066726 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1265/2518] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:31:52 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:31:53.071012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435426f-a709-440e-9140-db73b1af1fe9 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:53.081600 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435426f-a709-440e-9140-db73b1af1fe9 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:53.138331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68a78d-197e-43cf-8f47-a624d9ab3340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:53.138867 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68a78d-197e-43cf-8f47-a624d9ab3340 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:53.139146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68a78d-197e-43cf-8f47-a624d9ab3340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:53.139453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68a78d-197e-43cf-8f47-a624d9ab3340 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:53.140090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68a78d-197e-43cf-8f47-a624d9ab3340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:53.141986 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68a78d-197e-43cf-8f47-a624d9ab3340 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:53.162951 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1254/2519] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:31:53 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:31:53.166962 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e1a2-8334-48e8-a860-a54ebbbd3ee5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:53.177823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e1a2-8334-48e8-a860-a54ebbbd3ee5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:53.182451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348096-b410-4b57-a7f8-52a0788ba23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:53.183051 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348096-b410-4b57-a7f8-52a0788ba23c admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:53.183387 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348096-b410-4b57-a7f8-52a0788ba23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:53.183653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348096-b410-4b57-a7f8-52a0788ba23c admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:53.184324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90348096-b410-4b57-a7f8-52a0788ba23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:53.185910 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90348096-b410-4b57-a7f8-52a0788ba23c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:53.197503 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1266/2520] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:31:53.201705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68a78d-197e-43cf-8f47-a624d9ab3340 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:53.211755 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68a78d-197e-43cf-8f47-a624d9ab3340 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:53.216302 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280b004-cbcf-4d93-8a11-c823289ef07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:53.216931 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b004-cbcf-4d93-8a11-c823289ef07f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:53.217206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b004-cbcf-4d93-8a11-c823289ef07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:53.217478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b004-cbcf-4d93-8a11-c823289ef07f admin admin] PATH_INFO: `/v3/projects/0a89de4d3b18486f9e0aa012f8f5aa87/users/02f1c2512704474d84d3d294e6511c1a/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:53.232280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280b004-cbcf-4d93-8a11-c823289ef07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a89de4d3b18486f9e0aa012f8f5aa87, user_id=02f1c2512704474d84d3d294e6511c1a, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:53.234941 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280b004-cbcf-4d93-8a11-c823289ef07f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:53.249030 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1255/2521] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:31:53 2022] PUT /identity/v3/projects/0a89de4d3b18486f9e0aa012f8f5aa87/users/02f1c2512704474d84d3d294e6511c1a/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:31:53.252979 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348096-b410-4b57-a7f8-52a0788ba23c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:53.263423 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348096-b410-4b57-a7f8-52a0788ba23c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:53.282976 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:53.322727 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b12238-70f1-4b4b-ba87-8aa2404ffa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:53.323399 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12238-70f1-4b4b-ba87-8aa2404ffa61 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:53.323633 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12238-70f1-4b4b-ba87-8aa2404ffa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:53.323906 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b12238-70f1-4b4b-ba87-8aa2404ffa61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:53.324541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b12238-70f1-4b4b-ba87-8aa2404ffa61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:53.326116 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b12238-70f1-4b4b-ba87-8aa2404ffa61 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:53.335692 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1267/2522] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:31:53.339847 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280b004-cbcf-4d93-8a11-c823289ef07f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:53.345212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:31:53.352386 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280b004-cbcf-4d93-8a11-c823289ef07f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:53.356954 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6142dac-8dc0-4604-a117-3893bdde8cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:53.357595 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142dac-8dc0-4604-a117-3893bdde8cff admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:53.357876 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142dac-8dc0-4604-a117-3893bdde8cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:53.358163 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6142dac-8dc0-4604-a117-3893bdde8cff admin admin] PATH_INFO: `/v3/projects/0a89de4d3b18486f9e0aa012f8f5aa87/users/02f1c2512704474d84d3d294e6511c1a/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:53.360073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6142dac-8dc0-4604-a117-3893bdde8cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a89de4d3b18486f9e0aa012f8f5aa87, user_id=02f1c2512704474d84d3d294e6511c1a, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:53.363296 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6142dac-8dc0-4604-a117-3893bdde8cff admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:53.373206 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1256/2523] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:31:53 2022] PUT /identity/v3/projects/0a89de4d3b18486f9e0aa012f8f5aa87/users/02f1c2512704474d84d3d294e6511c1a/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:31:53.383080 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c74752-f16d-46f9-909e-b0679e62c9b4 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:53.383412 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c74752-f16d-46f9-909e-b0679e62c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:53.383681 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c74752-f16d-46f9-909e-b0679e62c9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:53.411905 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-97c74752-f16d-46f9-909e-b0679e62c9b4 None None] MFA Rules not processed for user `02f1c2512704474d84d3d294e6511c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:31:53.413038 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-97c74752-f16d-46f9-909e-b0679e62c9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:53.480041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1268/2524] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:31:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:31:53.491820 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6142dac-8dc0-4604-a117-3893bdde8cff admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:53.493486 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c6142dac-8dc0-4604-a117-3893bdde8cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:31:53.549455 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6142dac-8dc0-4604-a117-3893bdde8cff admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:53.553646 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160029-d964-4750-9843-c8da64facb11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:53.554243 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160029-d964-4750-9843-c8da64facb11 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:53.554520 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160029-d964-4750-9843-c8da64facb11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:53.554795 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160029-d964-4750-9843-c8da64facb11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:53.563999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15160029-d964-4750-9843-c8da64facb11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:53.565416 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15160029-d964-4750-9843-c8da64facb11 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:53.574917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1257/2525] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:31:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:31:53.649929 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c74752-f16d-46f9-909e-b0679e62c9b4 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:31:53.660277 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c74752-f16d-46f9-909e-b0679e62c9b4 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:31:53.663921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fe73c-dbbb-44a8-818c-fe48c7e656e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:31:53.664463 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe73c-dbbb-44a8-818c-fe48c7e656e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:31:53.664743 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe73c-dbbb-44a8-818c-fe48c7e656e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:31:53.665018 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe73c-dbbb-44a8-818c-fe48c7e656e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:31:53.719800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fe73c-dbbb-44a8-818c-fe48c7e656e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:31:53.721216 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fe73c-dbbb-44a8-818c-fe48c7e656e6 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:31:53.730600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1269/2526] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:31:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:00.471108 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160029-d964-4750-9843-c8da64facb11 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:00.533024 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160029-d964-4750-9843-c8da64facb11 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:00.537521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:00.538187 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:00.538463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:00.538738 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] PATH_INFO: `/v3/users/cdcfe5327de744aea9f47a2f2bb5fb12` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:00.539852 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdcfe5327de744aea9f47a2f2bb5fb12)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:00.542785 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:00.587541 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdcfe5327de744aea9f47a2f2bb5fb12'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:00.594281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdcfe5327de744aea9f47a2f2bb5fb12'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:00.601183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdcfe5327de744aea9f47a2f2bb5fb12'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:00.614073 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdcfe5327de744aea9f47a2f2bb5fb12'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:00.614705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdcfe5327de744aea9f47a2f2bb5fb12'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:00.620463 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1258/2527] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:32:00 2022] DELETE /identity/v3/users/cdcfe5327de744aea9f47a2f2bb5fb12 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:00.624973 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2aed9-9557-46a5-bfe7-6d33113ffd57 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:00.625444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2aed9-9557-46a5-bfe7-6d33113ffd57 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:00.625553 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2aed9-9557-46a5-bfe7-6d33113ffd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:00.645044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-17b2aed9-9557-46a5-bfe7-6d33113ffd57 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:00.646239 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-17b2aed9-9557-46a5-bfe7-6d33113ffd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:00.685474 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:00.704594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1270/2528] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:00.714699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:00.716134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:00.729546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:00.774441 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fc93-dfcf-4eee-97b7-81ad13a1215c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:00.778127 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca67e8-07d4-4312-b83d-4c88b9d0f8d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:00.778730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca67e8-07d4-4312-b83d-4c88b9d0f8d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:00.779008 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca67e8-07d4-4312-b83d-4c88b9d0f8d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:00.779291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca67e8-07d4-4312-b83d-4c88b9d0f8d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:00.788213 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca67e8-07d4-4312-b83d-4c88b9d0f8d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:00.789633 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca67e8-07d4-4312-b83d-4c88b9d0f8d3 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:00.798969 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1259/2529] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:01.060354 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2aed9-9557-46a5-bfe7-6d33113ffd57 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:01.061413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-17b2aed9-9557-46a5-bfe7-6d33113ffd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:01.074202 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2aed9-9557-46a5-bfe7-6d33113ffd57 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:01.078773 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:01.079451 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:01.079730 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:01.080008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] PATH_INFO: `/v3/projects/0c604ebeb6f0498d90130c558fd92c13` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:01.081268 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c604ebeb6f0498d90130c558fd92c13)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:01.083391 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:01.131447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c604ebeb6f0498d90130c558fd92c13', 'request_id': 'req-07d1aca7-e06f-45bb-a64e-5725f8def5ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.136835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c604ebeb6f0498d90130c558fd92c13', 'request_id': 'req-07d1aca7-e06f-45bb-a64e-5725f8def5ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.142840 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c604ebeb6f0498d90130c558fd92c13', 'request_id': 'req-07d1aca7-e06f-45bb-a64e-5725f8def5ad'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.155397 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] The token cache is being invalidate because project 0c604ebeb6f0498d90130c558fd92c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:32:01.155684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.156297 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.157761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1271/2530] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:32:01 2022] DELETE /identity/v3/projects/0c604ebeb6f0498d90130c558fd92c13 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:01.161908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca67e8-07d4-4312-b83d-4c88b9d0f8d3 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:01.171253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca67e8-07d4-4312-b83d-4c88b9d0f8d3 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:01.226722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:01.227368 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:01.227652 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:01.227920 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] PATH_INFO: `/v3/users/02f1c2512704474d84d3d294e6511c1a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:01.229012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f1c2512704474d84d3d294e6511c1a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:01.230898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:01.274323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f1c2512704474d84d3d294e6511c1a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.281078 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f1c2512704474d84d3d294e6511c1a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.287773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f1c2512704474d84d3d294e6511c1a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.299539 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f1c2512704474d84d3d294e6511c1a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.300699 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fb90a02c-6fca-4b11-8747-68dc05c2cb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f1c2512704474d84d3d294e6511c1a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.306601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1260/2531] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:32:01 2022] DELETE /identity/v3/users/02f1c2512704474d84d3d294e6511c1a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:32:01.572722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:01.574263 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:01.587481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1aca7-e06f-45bb-a64e-5725f8def5ad admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:01.647155 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:01.647852 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:01.648086 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:01.648364 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] PATH_INFO: `/v3/projects/0a89de4d3b18486f9e0aa012f8f5aa87` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:01.649486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a89de4d3b18486f9e0aa012f8f5aa87)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:01.651424 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:01.699550 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a89de4d3b18486f9e0aa012f8f5aa87', 'request_id': 'req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.705211 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a89de4d3b18486f9e0aa012f8f5aa87', 'request_id': 'req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.711491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a89de4d3b18486f9e0aa012f8f5aa87', 'request_id': 'req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.719793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:01.725477 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] The token cache is being invalidate because project 0a89de4d3b18486f9e0aa012f8f5aa87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:32:01.726044 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.727178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8b0e8ade-f050-4ff4-8b95-d9171c647fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:01.728874 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1272/2532] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:32:01 2022] DELETE /identity/v3/projects/0a89de4d3b18486f9e0aa012f8f5aa87 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:32:01.733899 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1028-e189-457f-bcd2-a3d260542c15 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:01.734363 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1028-e189-457f-bcd2-a3d260542c15 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:01.734469 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1028-e189-457f-bcd2-a3d260542c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:01.754310 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ab4d1028-e189-457f-bcd2-a3d260542c15 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:01.755549 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ab4d1028-e189-457f-bcd2-a3d260542c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:01.783862 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:01.816953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1261/2533] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:01.826285 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78621070-2655-4599-aa3f-cc1be60d20e0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:01.826575 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78621070-2655-4599-aa3f-cc1be60d20e0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:01.826853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78621070-2655-4599-aa3f-cc1be60d20e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:01.848008 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-78621070-2655-4599-aa3f-cc1be60d20e0 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:01.850069 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-78621070-2655-4599-aa3f-cc1be60d20e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:01.858751 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1273/2534] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:01.862987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1028-e189-457f-bcd2-a3d260542c15 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:01.872614 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1028-e189-457f-bcd2-a3d260542c15 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:01.877090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b90e6e-da06-4636-b180-de89944b743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:01.877678 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b90e6e-da06-4636-b180-de89944b743b admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:01.877952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b90e6e-da06-4636-b180-de89944b743b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:01.878221 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b90e6e-da06-4636-b180-de89944b743b admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:01.878995 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b90e6e-da06-4636-b180-de89944b743b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:32:01.879318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b90e6e-da06-4636-b180-de89944b743b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:01.880897 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b90e6e-da06-4636-b180-de89944b743b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:01.892312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1262/2535] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:32:01.897052 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78621070-2655-4599-aa3f-cc1be60d20e0 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:01.906229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78621070-2655-4599-aa3f-cc1be60d20e0 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:01.911572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95b9d5-c279-4b25-a8e9-6a6edd30634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:01.912170 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95b9d5-c279-4b25-a8e9-6a6edd30634b admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:01.912495 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95b9d5-c279-4b25-a8e9-6a6edd30634b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:01.912716 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95b9d5-c279-4b25-a8e9-6a6edd30634b admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:01.913342 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95b9d5-c279-4b25-a8e9-6a6edd30634b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:01.915214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95b9d5-c279-4b25-a8e9-6a6edd30634b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:01.941549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1274/2536] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:32:01 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:32:01.945546 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b90e6e-da06-4636-b180-de89944b743b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:01.955594 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b90e6e-da06-4636-b180-de89944b743b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.009529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ecc14-5357-4b2e-a847-82b688216e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.010120 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ecc14-5357-4b2e-a847-82b688216e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.010396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ecc14-5357-4b2e-a847-82b688216e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.010665 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ecc14-5357-4b2e-a847-82b688216e1f admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.011392 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ecc14-5357-4b2e-a847-82b688216e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.013194 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ecc14-5357-4b2e-a847-82b688216e1f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.034072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1263/2537] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:32:01 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:32:02.038731 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95b9d5-c279-4b25-a8e9-6a6edd30634b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.048966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95b9d5-c279-4b25-a8e9-6a6edd30634b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.053625 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee5485-6ace-4c40-b28b-253d8657a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.054236 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee5485-6ace-4c40-b28b-253d8657a01e admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.054517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee5485-6ace-4c40-b28b-253d8657a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.054794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee5485-6ace-4c40-b28b-253d8657a01e admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.055469 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee5485-6ace-4c40-b28b-253d8657a01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.057047 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee5485-6ace-4c40-b28b-253d8657a01e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.067385 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1275/2538] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:02.071586 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ecc14-5357-4b2e-a847-82b688216e1f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.082134 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ecc14-5357-4b2e-a847-82b688216e1f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.086829 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5ccb7-9b35-49c0-bea0-27bc50e64eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.087451 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5ccb7-9b35-49c0-bea0-27bc50e64eec admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.087731 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5ccb7-9b35-49c0-bea0-27bc50e64eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.088031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5ccb7-9b35-49c0-bea0-27bc50e64eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.088654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5ccb7-9b35-49c0-bea0-27bc50e64eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.090228 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5ccb7-9b35-49c0-bea0-27bc50e64eec admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.101046 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1264/2539] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:02.104919 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee5485-6ace-4c40-b28b-253d8657a01e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.114782 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee5485-6ace-4c40-b28b-253d8657a01e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.119430 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cce9b-8534-463d-95de-393795d7c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.120069 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cce9b-8534-463d-95de-393795d7c1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.120353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cce9b-8534-463d-95de-393795d7c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.120630 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cce9b-8534-463d-95de-393795d7c1f0 admin admin] PATH_INFO: `/v3/projects/d6306e3aee544b2bb3502b5847949c59/users/9ed1e0665eb1462181b1fa0a026e58c9/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.135264 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cce9b-8534-463d-95de-393795d7c1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6306e3aee544b2bb3502b5847949c59, user_id=9ed1e0665eb1462181b1fa0a026e58c9, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.137947 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cce9b-8534-463d-95de-393795d7c1f0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.151096 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1276/2540] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:32:02 2022] PUT /identity/v3/projects/d6306e3aee544b2bb3502b5847949c59/users/9ed1e0665eb1462181b1fa0a026e58c9/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:32:02.161746 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b67c0-979a-4fca-9b9e-8252ca7c8da3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.162026 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b67c0-979a-4fca-9b9e-8252ca7c8da3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.162294 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b67c0-979a-4fca-9b9e-8252ca7c8da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.189040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e20b67c0-979a-4fca-9b9e-8252ca7c8da3 None None] MFA Rules not processed for user `9ed1e0665eb1462181b1fa0a026e58c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:02.190229 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e20b67c0-979a-4fca-9b9e-8252ca7c8da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:02.252079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1265/2541] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:02.257002 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cce9b-8534-463d-95de-393795d7c1f0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.317990 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cce9b-8534-463d-95de-393795d7c1f0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.322922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553d74d-ecec-4d62-97a9-d1600671796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.323564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553d74d-ecec-4d62-97a9-d1600671796b admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.323850 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553d74d-ecec-4d62-97a9-d1600671796b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.324127 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553d74d-ecec-4d62-97a9-d1600671796b admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.324767 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553d74d-ecec-4d62-97a9-d1600671796b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.326678 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553d74d-ecec-4d62-97a9-d1600671796b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.352823 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1277/2542] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:32:02 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:32:02.356827 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b67c0-979a-4fca-9b9e-8252ca7c8da3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.367336 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b67c0-979a-4fca-9b9e-8252ca7c8da3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.393323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:02.424338 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015778e6-017d-42f0-9fc4-c793f9515c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.424942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015778e6-017d-42f0-9fc4-c793f9515c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.425253 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015778e6-017d-42f0-9fc4-c793f9515c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.425525 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015778e6-017d-42f0-9fc4-c793f9515c01 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.426168 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015778e6-017d-42f0-9fc4-c793f9515c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.428126 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015778e6-017d-42f0-9fc4-c793f9515c01 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.450483 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1266/2543] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:32:02 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:32:02.454480 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553d74d-ecec-4d62-97a9-d1600671796b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.465341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553d74d-ecec-4d62-97a9-d1600671796b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.470000 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6633c7-121f-4ddc-8002-f943223c3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.470598 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6633c7-121f-4ddc-8002-f943223c3615 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.470879 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6633c7-121f-4ddc-8002-f943223c3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.471151 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6633c7-121f-4ddc-8002-f943223c3615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.471824 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6633c7-121f-4ddc-8002-f943223c3615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.473404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6633c7-121f-4ddc-8002-f943223c3615 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.483758 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1278/2544] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:02.487911 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015778e6-017d-42f0-9fc4-c793f9515c01 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.497896 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015778e6-017d-42f0-9fc4-c793f9515c01 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.502596 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257c1a-fa5b-4cee-a042-7473cadfe35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.503787 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257c1a-fa5b-4cee-a042-7473cadfe35a admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.504072 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257c1a-fa5b-4cee-a042-7473cadfe35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.504343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257c1a-fa5b-4cee-a042-7473cadfe35a admin admin] PATH_INFO: `/v3/projects/803f9dbcfeb348a08a95068876c54302/users/81bd135223e441a9a8a778f3bbcf6f7a/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.518635 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f257c1a-fa5b-4cee-a042-7473cadfe35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=803f9dbcfeb348a08a95068876c54302, user_id=81bd135223e441a9a8a778f3bbcf6f7a, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.521906 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f257c1a-fa5b-4cee-a042-7473cadfe35a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.536383 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1267/2545] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:32:02 2022] PUT /identity/v3/projects/803f9dbcfeb348a08a95068876c54302/users/81bd135223e441a9a8a778f3bbcf6f7a/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:32:02.540372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6633c7-121f-4ddc-8002-f943223c3615 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.550812 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6633c7-121f-4ddc-8002-f943223c3615 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.606634 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866f872-d044-4080-aff8-82562707c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.607225 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f872-d044-4080-aff8-82562707c7ba admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.607542 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f872-d044-4080-aff8-82562707c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.607816 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f872-d044-4080-aff8-82562707c7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.608447 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866f872-d044-4080-aff8-82562707c7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.610045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866f872-d044-4080-aff8-82562707c7ba admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.620109 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1279/2546] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:32:02.624968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257c1a-fa5b-4cee-a042-7473cadfe35a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.635700 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257c1a-fa5b-4cee-a042-7473cadfe35a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.640448 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a69b17-e9f6-4614-9b4f-f58519e489b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.641090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69b17-e9f6-4614-9b4f-f58519e489b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.641374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69b17-e9f6-4614-9b4f-f58519e489b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.641648 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69b17-e9f6-4614-9b4f-f58519e489b3 admin admin] PATH_INFO: `/v3/projects/803f9dbcfeb348a08a95068876c54302/users/81bd135223e441a9a8a778f3bbcf6f7a/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.643587 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a69b17-e9f6-4614-9b4f-f58519e489b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803f9dbcfeb348a08a95068876c54302, user_id=81bd135223e441a9a8a778f3bbcf6f7a, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.646237 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a69b17-e9f6-4614-9b4f-f58519e489b3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.656266 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1268/2547] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:32:02 2022] PUT /identity/v3/projects/803f9dbcfeb348a08a95068876c54302/users/81bd135223e441a9a8a778f3bbcf6f7a/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:02.666366 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61233a19-31cd-48e6-bbf8-6dbe70f6b57d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.666853 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61233a19-31cd-48e6-bbf8-6dbe70f6b57d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.666963 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61233a19-31cd-48e6-bbf8-6dbe70f6b57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.674898 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:02.696479 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-61233a19-31cd-48e6-bbf8-6dbe70f6b57d None None] MFA Rules not processed for user `81bd135223e441a9a8a778f3bbcf6f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:02.697693 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-61233a19-31cd-48e6-bbf8-6dbe70f6b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:02.763041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1280/2548] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:02.774186 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a69b17-e9f6-4614-9b4f-f58519e489b3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.775992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-17a69b17-e9f6-4614-9b4f-f58519e489b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:02.835031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a69b17-e9f6-4614-9b4f-f58519e489b3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.838722 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca659ed2-1a69-42bc-9c7c-b41e5cf91b51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.839362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca659ed2-1a69-42bc-9c7c-b41e5cf91b51 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.839645 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca659ed2-1a69-42bc-9c7c-b41e5cf91b51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.839917 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca659ed2-1a69-42bc-9c7c-b41e5cf91b51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.848883 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca659ed2-1a69-42bc-9c7c-b41e5cf91b51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.850300 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca659ed2-1a69-42bc-9c7c-b41e5cf91b51 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:02.859610 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1269/2549] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:02.888925 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61233a19-31cd-48e6-bbf8-6dbe70f6b57d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:02.949722 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61233a19-31cd-48e6-bbf8-6dbe70f6b57d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:02.954270 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:02.954876 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:02.955152 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:02.955458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] PATH_INFO: `/v3/users/9ed1e0665eb1462181b1fa0a026e58c9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:02.956572 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed1e0665eb1462181b1fa0a026e58c9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:02.958455 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:03.002573 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed1e0665eb1462181b1fa0a026e58c9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.003256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed1e0665eb1462181b1fa0a026e58c9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.010353 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed1e0665eb1462181b1fa0a026e58c9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.017410 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed1e0665eb1462181b1fa0a026e58c9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.017986 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed1e0665eb1462181b1fa0a026e58c9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.035305 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1281/2550] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:32:02 2022] DELETE /identity/v3/users/9ed1e0665eb1462181b1fa0a026e58c9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:03.039636 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94442-bd90-49ae-8800-a4580b49b3b2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:03.039923 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94442-bd90-49ae-8800-a4580b49b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:03.040227 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94442-bd90-49ae-8800-a4580b49b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:03.060942 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-32a94442-bd90-49ae-8800-a4580b49b3b2 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:03.062190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-32a94442-bd90-49ae-8800-a4580b49b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:03.119359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1270/2551] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:03.129030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:03.130418 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:03.141088 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:03.190486 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fcf09-5e6b-4114-96b6-ca6ee6d5a9b1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:03.194113 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35af996-32f6-4863-be5f-67d5491cc873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:03.194720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35af996-32f6-4863-be5f-67d5491cc873 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:03.195000 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35af996-32f6-4863-be5f-67d5491cc873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:03.195291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35af996-32f6-4863-be5f-67d5491cc873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:03.204323 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35af996-32f6-4863-be5f-67d5491cc873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:03.205900 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35af996-32f6-4863-be5f-67d5491cc873 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:03.215159 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1282/2552] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:03.475068 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a94442-bd90-49ae-8800-a4580b49b3b2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:03.476990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-32a94442-bd90-49ae-8800-a4580b49b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:03.491090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a94442-bd90-49ae-8800-a4580b49b3b2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:03.496035 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:03.496900 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:03.497177 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:03.497453 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] PATH_INFO: `/v3/projects/d6306e3aee544b2bb3502b5847949c59` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:03.498601 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6306e3aee544b2bb3502b5847949c59)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:03.500554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:03.522362 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:03.546816 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6306e3aee544b2bb3502b5847949c59', 'request_id': 'req-54e2c4d7-0d23-4217-a192-1e9716fd5d24'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.554331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6306e3aee544b2bb3502b5847949c59', 'request_id': 'req-54e2c4d7-0d23-4217-a192-1e9716fd5d24'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.559968 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6306e3aee544b2bb3502b5847949c59', 'request_id': 'req-54e2c4d7-0d23-4217-a192-1e9716fd5d24'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.571898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] The token cache is being invalidate because project d6306e3aee544b2bb3502b5847949c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:32:03.572188 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.572823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.574334 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1271/2553] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:32:03 2022] DELETE /identity/v3/projects/d6306e3aee544b2bb3502b5847949c59 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:32:03.578319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35af996-32f6-4863-be5f-67d5491cc873 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:03.587777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35af996-32f6-4863-be5f-67d5491cc873 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:03.643709 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:03.644394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:03.644783 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:03.645066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] PATH_INFO: `/v3/users/81bd135223e441a9a8a778f3bbcf6f7a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:03.646206 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bd135223e441a9a8a778f3bbcf6f7a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:03.648141 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:03.694419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bd135223e441a9a8a778f3bbcf6f7a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.695041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bd135223e441a9a8a778f3bbcf6f7a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.702398 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bd135223e441a9a8a778f3bbcf6f7a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.709400 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bd135223e441a9a8a778f3bbcf6f7a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.710229 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-639270e9-832d-409a-8861-d38b3b6c38f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bd135223e441a9a8a778f3bbcf6f7a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:03.728163 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1283/2554] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:32:03 2022] DELETE /identity/v3/users/81bd135223e441a9a8a778f3bbcf6f7a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:03.993048 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:03.994681 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:04.015252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2c4d7-0d23-4217-a192-1e9716fd5d24 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:04.072965 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:04.073669 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.073887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.074165 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] PATH_INFO: `/v3/projects/803f9dbcfeb348a08a95068876c54302` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.075306 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=803f9dbcfeb348a08a95068876c54302)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:04.077211 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:04.123947 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803f9dbcfeb348a08a95068876c54302', 'request_id': 'req-631eb91a-9316-4073-9439-2399af1b5b5c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:04.130790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803f9dbcfeb348a08a95068876c54302', 'request_id': 'req-631eb91a-9316-4073-9439-2399af1b5b5c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:04.136564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803f9dbcfeb348a08a95068876c54302', 'request_id': 'req-631eb91a-9316-4073-9439-2399af1b5b5c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:04.147913 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] The token cache is being invalidate because project 803f9dbcfeb348a08a95068876c54302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:32:04.148203 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:04.148853 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-631eb91a-9316-4073-9439-2399af1b5b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:04.150313 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1272/2555] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:32:03 2022] DELETE /identity/v3/projects/803f9dbcfeb348a08a95068876c54302 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:04.155394 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb0df-392b-4133-aa72-fcfbb23efc1a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.155686 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb0df-392b-4133-aa72-fcfbb23efc1a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.155967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb0df-392b-4133-aa72-fcfbb23efc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.175864 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-94fcb0df-392b-4133-aa72-fcfbb23efc1a None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:04.177062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-94fcb0df-392b-4133-aa72-fcfbb23efc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:04.202301 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:04.237814 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1284/2556] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:04.246647 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960640-9086-4645-b3c5-0c158cca39ba None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.246930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960640-9086-4645-b3c5-0c158cca39ba None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.247202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960640-9086-4645-b3c5-0c158cca39ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.266515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a9960640-9086-4645-b3c5-0c158cca39ba None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:04.267779 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a9960640-9086-4645-b3c5-0c158cca39ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:04.276274 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1273/2557] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:04.280549 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb0df-392b-4133-aa72-fcfbb23efc1a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:04.291755 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb0df-392b-4133-aa72-fcfbb23efc1a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:04.296413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76cae-a265-4059-a992-b095ea2bd5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:04.297021 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76cae-a265-4059-a992-b095ea2bd5ff admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.297302 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76cae-a265-4059-a992-b095ea2bd5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.297574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76cae-a265-4059-a992-b095ea2bd5ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.298219 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76cae-a265-4059-a992-b095ea2bd5ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:32:04.298522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76cae-a265-4059-a992-b095ea2bd5ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:04.300140 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76cae-a265-4059-a992-b095ea2bd5ff admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:04.311902 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1285/2558] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 21 21:32:04.316301 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9960640-9086-4645-b3c5-0c158cca39ba None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:04.325783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9960640-9086-4645-b3c5-0c158cca39ba None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:04.330307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827bf3b-1c3d-4a37-a81e-82a51d1e13a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:04.331844 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827bf3b-1c3d-4a37-a81e-82a51d1e13a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.331844 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827bf3b-1c3d-4a37-a81e-82a51d1e13a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.332191 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827bf3b-1c3d-4a37-a81e-82a51d1e13a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.332715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827bf3b-1c3d-4a37-a81e-82a51d1e13a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:04.334503 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827bf3b-1c3d-4a37-a81e-82a51d1e13a2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:04.361715 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1274/2559] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:32:04 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:32:04.366082 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76cae-a265-4059-a992-b095ea2bd5ff admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:04.376020 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76cae-a265-4059-a992-b095ea2bd5ff admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:04.432513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eace01f-ce0e-4f2f-ae77-9b27074d45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:04.433123 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eace01f-ce0e-4f2f-ae77-9b27074d45d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.433403 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eace01f-ce0e-4f2f-ae77-9b27074d45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.433676 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eace01f-ce0e-4f2f-ae77-9b27074d45d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.434303 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eace01f-ce0e-4f2f-ae77-9b27074d45d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:04.436251 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eace01f-ce0e-4f2f-ae77-9b27074d45d7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:04.457880 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1286/2560] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:32:04 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:32:04.461933 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827bf3b-1c3d-4a37-a81e-82a51d1e13a2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:04.472088 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827bf3b-1c3d-4a37-a81e-82a51d1e13a2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:04.476591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3d272-aa8f-479d-a3dd-4db83b1934a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:04.477183 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3d272-aa8f-479d-a3dd-4db83b1934a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.477460 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3d272-aa8f-479d-a3dd-4db83b1934a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.477732 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3d272-aa8f-479d-a3dd-4db83b1934a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.478361 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3d272-aa8f-479d-a3dd-4db83b1934a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:04.479983 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3d272-aa8f-479d-a3dd-4db83b1934a0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:04.481953 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:04.491204 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1275/2561] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:04.497849 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eace01f-ce0e-4f2f-ae77-9b27074d45d7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:04.508413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eace01f-ce0e-4f2f-ae77-9b27074d45d7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:04.513168 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cf30c-ae97-4e44-8649-0569f6fc05d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:04.513761 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cf30c-ae97-4e44-8649-0569f6fc05d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.514041 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cf30c-ae97-4e44-8649-0569f6fc05d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.514319 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cf30c-ae97-4e44-8649-0569f6fc05d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.514958 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cf30c-ae97-4e44-8649-0569f6fc05d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:04.516564 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cf30c-ae97-4e44-8649-0569f6fc05d9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:04.527774 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1287/2562] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:04.531915 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3d272-aa8f-479d-a3dd-4db83b1934a0 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:04.541682 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3d272-aa8f-479d-a3dd-4db83b1934a0 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:04.546265 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a90a0-7262-46ca-a840-9619d52b89a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:04.546903 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a90a0-7262-46ca-a840-9619d52b89a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.547179 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a90a0-7262-46ca-a840-9619d52b89a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.547488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a90a0-7262-46ca-a840-9619d52b89a1 admin admin] PATH_INFO: `/v3/projects/0141db32294f4793acf1b47b82f7e169/users/c0133d3d287b4a6e9fabad75aedccbb6/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.561511 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a90a0-7262-46ca-a840-9619d52b89a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0141db32294f4793acf1b47b82f7e169, user_id=c0133d3d287b4a6e9fabad75aedccbb6, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:04.564175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a90a0-7262-46ca-a840-9619d52b89a1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:04.577653 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1276/2563] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:32:04 2022] PUT /identity/v3/projects/0141db32294f4793acf1b47b82f7e169/users/c0133d3d287b4a6e9fabad75aedccbb6/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:04.588379 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077562a2-bbd9-496d-aeea-f168be799ba0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.588672 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077562a2-bbd9-496d-aeea-f168be799ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.588954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077562a2-bbd9-496d-aeea-f168be799ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.616604 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-077562a2-bbd9-496d-aeea-f168be799ba0 None None] MFA Rules not processed for user `c0133d3d287b4a6e9fabad75aedccbb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:04.617799 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-077562a2-bbd9-496d-aeea-f168be799ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:04.679795 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1288/2564] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 21 21:32:04.692312 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a90a0-7262-46ca-a840-9619d52b89a1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:04.694019 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a85a90a0-7262-46ca-a840-9619d52b89a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:04.770805 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a90a0-7262-46ca-a840-9619d52b89a1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:04.774536 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bfa1b-36f5-4b8d-a05f-efabaff29e35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec1b2a49264e4e9218b65f9ff114b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:04.775141 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bfa1b-36f5-4b8d-a05f-efabaff29e35 service glance] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:04.775450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bfa1b-36f5-4b8d-a05f-efabaff29e35 service glance] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:04.775724 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bfa1b-36f5-4b8d-a05f-efabaff29e35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:04.783902 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bfa1b-36f5-4b8d-a05f-efabaff29e35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:04.785343 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bfa1b-36f5-4b8d-a05f-efabaff29e35 service glance] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:04.793998 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1277/2565] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:14.676872 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:14.790065 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=46,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:20.279602 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077562a2-bbd9-496d-aeea-f168be799ba0 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:20.341501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077562a2-bbd9-496d-aeea-f168be799ba0 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:20.345894 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:20.346517 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:20.346793 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:20.347132 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] PATH_INFO: `/v3/users/c0133d3d287b4a6e9fabad75aedccbb6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:20.348274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0133d3d287b4a6e9fabad75aedccbb6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:20.350165 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:20.395148 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0133d3d287b4a6e9fabad75aedccbb6'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:20.395844 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0133d3d287b4a6e9fabad75aedccbb6'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:20.402735 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0133d3d287b4a6e9fabad75aedccbb6'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:20.409669 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0133d3d287b4a6e9fabad75aedccbb6'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:20.410482 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0133d3d287b4a6e9fabad75aedccbb6'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:20.427481 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1289/2566] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:32:20 2022] DELETE /identity/v3/users/c0133d3d287b4a6e9fabad75aedccbb6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:20.432145 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e4cbf-afd2-43a7-8e04-f22600470405 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:20.432650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e4cbf-afd2-43a7-8e04-f22600470405 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:20.432750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e4cbf-afd2-43a7-8e04-f22600470405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:20.452052 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3a1e4cbf-afd2-43a7-8e04-f22600470405 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:20.453246 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3a1e4cbf-afd2-43a7-8e04-f22600470405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:20.510283 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1278/2567] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:20.520497 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:20.521858 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:20.577737 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61376-6ab8-49fc-bbd6-4a87ff24d159 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:20.581328 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e72da4-2cfb-4f45-a68a-5163ca6baac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:20.581920 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e72da4-2cfb-4f45-a68a-5163ca6baac7 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:20.582198 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e72da4-2cfb-4f45-a68a-5163ca6baac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:20.582468 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e72da4-2cfb-4f45-a68a-5163ca6baac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:20.591208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e72da4-2cfb-4f45-a68a-5163ca6baac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:20.592683 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e72da4-2cfb-4f45-a68a-5163ca6baac7 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:20.601956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1290/2568] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 21 21:32:20.863564 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e4cbf-afd2-43a7-8e04-f22600470405 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:20.864992 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3a1e4cbf-afd2-43a7-8e04-f22600470405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:20.877663 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e4cbf-afd2-43a7-8e04-f22600470405 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:20.883051 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:20.883750 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:20.884031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:20.884303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] PATH_INFO: `/v3/projects/0141db32294f4793acf1b47b82f7e169` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:20.885461 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0141db32294f4793acf1b47b82f7e169)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:20.887417 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:20.936293 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0141db32294f4793acf1b47b82f7e169', 'request_id': 'req-e505e097-93d6-48bf-bc23-0503157a4133'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:20.943146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0141db32294f4793acf1b47b82f7e169', 'request_id': 'req-e505e097-93d6-48bf-bc23-0503157a4133'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:20.948987 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0141db32294f4793acf1b47b82f7e169', 'request_id': 'req-e505e097-93d6-48bf-bc23-0503157a4133'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:20.959796 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] The token cache is being invalidate because project 0141db32294f4793acf1b47b82f7e169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:32:20.960077 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:20.960684 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e505e097-93d6-48bf-bc23-0503157a4133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:20.962169 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1279/2569] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:32:20 2022] DELETE /identity/v3/projects/0141db32294f4793acf1b47b82f7e169 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:20.966967 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745b02a-9529-4642-940c-652f218ee619 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:20.967248 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745b02a-9529-4642-940c-652f218ee619 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:20.967540 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745b02a-9529-4642-940c-652f218ee619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:20.988713 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-2745b02a-9529-4642-940c-652f218ee619 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:20.989890 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2745b02a-9529-4642-940c-652f218ee619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:21.006551 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:21.053115 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1291/2570] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:21.058419 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19623def-2775-46f0-b98e-4d4e78eedd0b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:21.058713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19623def-2775-46f0-b98e-4d4e78eedd0b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:21.058996 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19623def-2775-46f0-b98e-4d4e78eedd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:21.079762 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-19623def-2775-46f0-b98e-4d4e78eedd0b None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:21.080962 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-19623def-2775-46f0-b98e-4d4e78eedd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:21.091439 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1280/2571] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:21.095749 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745b02a-9529-4642-940c-652f218ee619 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:21.106153 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745b02a-9529-4642-940c-652f218ee619 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:21.110787 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dea87-4864-4a49-8bb5-a8bf3604e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:21.111419 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dea87-4864-4a49-8bb5-a8bf3604e602 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:21.111699 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dea87-4864-4a49-8bb5-a8bf3604e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:21.111970 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dea87-4864-4a49-8bb5-a8bf3604e602 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:21.113232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dea87-4864-4a49-8bb5-a8bf3604e602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:32:21.113533 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dea87-4864-4a49-8bb5-a8bf3604e602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:21.115139 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dea87-4864-4a49-8bb5-a8bf3604e602 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:21.126457 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1292/2572] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:32:21.130838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19623def-2775-46f0-b98e-4d4e78eedd0b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:21.140307 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19623def-2775-46f0-b98e-4d4e78eedd0b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:21.144930 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32492-c873-4b3d-b1ee-3ea89126c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:21.145516 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32492-c873-4b3d-b1ee-3ea89126c69d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:21.145790 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32492-c873-4b3d-b1ee-3ea89126c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:21.146060 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32492-c873-4b3d-b1ee-3ea89126c69d admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:21.146672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c32492-c873-4b3d-b1ee-3ea89126c69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:21.148571 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c32492-c873-4b3d-b1ee-3ea89126c69d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:21.174799 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1281/2573] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:32:21 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:32:21.179541 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dea87-4864-4a49-8bb5-a8bf3604e602 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:21.189256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dea87-4864-4a49-8bb5-a8bf3604e602 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:21.244909 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323922ef-edc7-47d0-8615-a666914c7794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:21.245514 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323922ef-edc7-47d0-8615-a666914c7794 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:21.245794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323922ef-edc7-47d0-8615-a666914c7794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:21.246067 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323922ef-edc7-47d0-8615-a666914c7794 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:21.246720 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323922ef-edc7-47d0-8615-a666914c7794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:21.248631 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323922ef-edc7-47d0-8615-a666914c7794 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:21.268657 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1293/2574] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:32:21 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:32:21.272908 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32492-c873-4b3d-b1ee-3ea89126c69d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:21.283167 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32492-c873-4b3d-b1ee-3ea89126c69d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:21.288374 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862c55-253a-4eb6-8c7c-d8b6f2ed3dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:21.288971 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862c55-253a-4eb6-8c7c-d8b6f2ed3dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:21.289252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862c55-253a-4eb6-8c7c-d8b6f2ed3dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:21.289526 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862c55-253a-4eb6-8c7c-d8b6f2ed3dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:21.290164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862c55-253a-4eb6-8c7c-d8b6f2ed3dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:21.291787 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862c55-253a-4eb6-8c7c-d8b6f2ed3dd7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:21.302146 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1282/2575] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:21.305907 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323922ef-edc7-47d0-8615-a666914c7794 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:21.315821 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323922ef-edc7-47d0-8615-a666914c7794 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:21.320417 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f55b-77d7-4877-84b3-c4a8308a423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:21.321030 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f55b-77d7-4877-84b3-c4a8308a423f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:21.321570 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f55b-77d7-4877-84b3-c4a8308a423f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:21.321871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f55b-77d7-4877-84b3-c4a8308a423f admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:21.322501 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f55b-77d7-4877-84b3-c4a8308a423f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:21.324102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f55b-77d7-4877-84b3-c4a8308a423f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:21.335341 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1294/2576] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:21.339396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862c55-253a-4eb6-8c7c-d8b6f2ed3dd7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:21.349232 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862c55-253a-4eb6-8c7c-d8b6f2ed3dd7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:21.354061 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6f4a-2674-4001-8a6a-16a3c5c7ecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:21.354710 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6f4a-2674-4001-8a6a-16a3c5c7ecd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:21.354990 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6f4a-2674-4001-8a6a-16a3c5c7ecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:21.355261 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6f4a-2674-4001-8a6a-16a3c5c7ecd2 admin admin] PATH_INFO: `/v3/projects/1fd561b9f031403e906762feccb42818/users/78ba6e9f226940ebabdcae1dc1222da0/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:21.370223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e6f4a-2674-4001-8a6a-16a3c5c7ecd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd561b9f031403e906762feccb42818, user_id=78ba6e9f226940ebabdcae1dc1222da0, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:21.372844 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e6f4a-2674-4001-8a6a-16a3c5c7ecd2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:21.386284 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1283/2577] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:32:21 2022] PUT /identity/v3/projects/1fd561b9f031403e906762feccb42818/users/78ba6e9f226940ebabdcae1dc1222da0/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:21.397365 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810948-45c4-4d7d-914c-79535f036385 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:21.397649 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810948-45c4-4d7d-914c-79535f036385 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:21.397921 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810948-45c4-4d7d-914c-79535f036385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:21.424956 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-da810948-45c4-4d7d-914c-79535f036385 None None] MFA Rules not processed for user `78ba6e9f226940ebabdcae1dc1222da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:21.426653 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-da810948-45c4-4d7d-914c-79535f036385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:21.489965 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1295/2578] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:21.500649 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6f4a-2674-4001-8a6a-16a3c5c7ecd2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:21.502331 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6d6e6f4a-2674-4001-8a6a-16a3c5c7ecd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:21.524200 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:21.562488 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6f4a-2674-4001-8a6a-16a3c5c7ecd2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:21.566658 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b5c1a-ecc8-49ed-9195-7272363a9199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:21.567258 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b5c1a-ecc8-49ed-9195-7272363a9199 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:21.567569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b5c1a-ecc8-49ed-9195-7272363a9199 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:21.567844 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b5c1a-ecc8-49ed-9195-7272363a9199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:21.576205 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b5c1a-ecc8-49ed-9195-7272363a9199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:21.577624 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b5c1a-ecc8-49ed-9195-7272363a9199 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:21.586291 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1284/2579] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:24.571646 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da810948-45c4-4d7d-914c-79535f036385 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:24.590425 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:24.633230 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da810948-45c4-4d7d-914c-79535f036385 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:24.637674 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:24.638289 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:24.638563 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:24.638831 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] PATH_INFO: `/v3/users/78ba6e9f226940ebabdcae1dc1222da0` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:24.639942 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ba6e9f226940ebabdcae1dc1222da0)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:24.641835 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:24.685922 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ba6e9f226940ebabdcae1dc1222da0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:24.686555 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ba6e9f226940ebabdcae1dc1222da0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:24.694045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ba6e9f226940ebabdcae1dc1222da0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:24.701603 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ba6e9f226940ebabdcae1dc1222da0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:24.702237 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ba6e9f226940ebabdcae1dc1222da0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:24.719316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1296/2580] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:32:24 2022] DELETE /identity/v3/users/78ba6e9f226940ebabdcae1dc1222da0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:24.723752 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97a262-b135-4a72-9b23-5982de16c6e6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:24.724252 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97a262-b135-4a72-9b23-5982de16c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:24.724359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97a262-b135-4a72-9b23-5982de16c6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:24.743753 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5e97a262-b135-4a72-9b23-5982de16c6e6 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:24.744945 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5e97a262-b135-4a72-9b23-5982de16c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:24.802324 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1285/2581] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:24.812005 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:24.813407 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:24.870528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc2a7-d5ee-4e60-a80b-8d71a51f553e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:24.874108 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876ca1e-c764-40ec-bf4d-53e9545113d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:24.874703 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ca1e-c764-40ec-bf4d-53e9545113d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:24.874978 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ca1e-c764-40ec-bf4d-53e9545113d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:24.875249 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ca1e-c764-40ec-bf4d-53e9545113d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:24.884600 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876ca1e-c764-40ec-bf4d-53e9545113d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:24.886033 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876ca1e-c764-40ec-bf4d-53e9545113d3 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:24.896247 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1297/2582] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:25.156259 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97a262-b135-4a72-9b23-5982de16c6e6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:25.157666 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5e97a262-b135-4a72-9b23-5982de16c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:25.170529 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97a262-b135-4a72-9b23-5982de16c6e6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:25.175244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:25.176447 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.176729 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.177006 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] PATH_INFO: `/v3/projects/1fd561b9f031403e906762feccb42818` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.178138 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd561b9f031403e906762feccb42818)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:25.180070 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:25.226553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd561b9f031403e906762feccb42818', 'request_id': 'req-4c01c678-95ab-46be-98dd-b964a5a4aaee'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:25.233855 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd561b9f031403e906762feccb42818', 'request_id': 'req-4c01c678-95ab-46be-98dd-b964a5a4aaee'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:25.240021 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd561b9f031403e906762feccb42818', 'request_id': 'req-4c01c678-95ab-46be-98dd-b964a5a4aaee'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:25.250887 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] The token cache is being invalidate because project 1fd561b9f031403e906762feccb42818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:32:25.251175 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:25.251837 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4c01c678-95ab-46be-98dd-b964a5a4aaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:25.253320 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1286/2583] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:32:25 2022] DELETE /identity/v3/projects/1fd561b9f031403e906762feccb42818 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:25.258930 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221d28-b3b0-4df3-a0b8-77b759e223e3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.259220 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221d28-b3b0-4df3-a0b8-77b759e223e3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.259527 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221d28-b3b0-4df3-a0b8-77b759e223e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.278446 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4a221d28-b3b0-4df3-a0b8-77b759e223e3 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:25.279684 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4a221d28-b3b0-4df3-a0b8-77b759e223e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:25.313186 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:25.339076 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1298/2584] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:25.347420 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286a2fa-4823-4062-921b-edd3ee7ecbdf None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.347730 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286a2fa-4823-4062-921b-edd3ee7ecbdf None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.348012 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286a2fa-4823-4062-921b-edd3ee7ecbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.368009 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b286a2fa-4823-4062-921b-edd3ee7ecbdf None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:25.369218 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b286a2fa-4823-4062-921b-edd3ee7ecbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:25.377092 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1287/2585] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:25.381905 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a221d28-b3b0-4df3-a0b8-77b759e223e3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:25.391475 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a221d28-b3b0-4df3-a0b8-77b759e223e3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:25.396180 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55effd89-9c5f-415e-98a4-4c4de295ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:25.396777 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55effd89-9c5f-415e-98a4-4c4de295ba52 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.397072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55effd89-9c5f-415e-98a4-4c4de295ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.397338 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55effd89-9c5f-415e-98a4-4c4de295ba52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.397985 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55effd89-9c5f-415e-98a4-4c4de295ba52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 21 21:32:25.398291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55effd89-9c5f-415e-98a4-4c4de295ba52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:25.399917 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55effd89-9c5f-415e-98a4-4c4de295ba52 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:25.411807 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1299/2586] 10.222.0.23 () {58 vars in 1153 bytes} [Fri Oct 21 21:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 21 21:32:25.415991 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286a2fa-4823-4062-921b-edd3ee7ecbdf None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:25.425079 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286a2fa-4823-4062-921b-edd3ee7ecbdf None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:25.430414 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2f0e5-2980-4eae-b3d8-c2878f490302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:25.431014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f0e5-2980-4eae-b3d8-c2878f490302 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.431318 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f0e5-2980-4eae-b3d8-c2878f490302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.431599 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f0e5-2980-4eae-b3d8-c2878f490302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.432225 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2f0e5-2980-4eae-b3d8-c2878f490302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:25.434102 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2f0e5-2980-4eae-b3d8-c2878f490302 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:25.460404 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1288/2587] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:32:25 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:32:25.464643 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55effd89-9c5f-415e-98a4-4c4de295ba52 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:25.475093 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55effd89-9c5f-415e-98a4-4c4de295ba52 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:25.529349 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edba3eb-8075-4666-bf73-5e3b38b074ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:25.529952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edba3eb-8075-4666-bf73-5e3b38b074ac admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.530232 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edba3eb-8075-4666-bf73-5e3b38b074ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.530498 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edba3eb-8075-4666-bf73-5e3b38b074ac admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.531130 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edba3eb-8075-4666-bf73-5e3b38b074ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:25.533114 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edba3eb-8075-4666-bf73-5e3b38b074ac admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:25.555178 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1300/2588] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:32:25 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:32:25.559288 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2f0e5-2980-4eae-b3d8-c2878f490302 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:25.569858 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2f0e5-2980-4eae-b3d8-c2878f490302 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:25.574654 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627fba5-8e67-434b-95ba-febecdc6e1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:25.575244 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627fba5-8e67-434b-95ba-febecdc6e1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.575550 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627fba5-8e67-434b-95ba-febecdc6e1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.575823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627fba5-8e67-434b-95ba-febecdc6e1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.576450 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627fba5-8e67-434b-95ba-febecdc6e1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:25.578014 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627fba5-8e67-434b-95ba-febecdc6e1c8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:25.587681 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1289/2589] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:25.591348 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edba3eb-8075-4666-bf73-5e3b38b074ac admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:25.601604 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edba3eb-8075-4666-bf73-5e3b38b074ac admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:25.606335 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea78c6-52ce-4603-a036-b2b5b58da1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:25.606939 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea78c6-52ce-4603-a036-b2b5b58da1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.607223 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea78c6-52ce-4603-a036-b2b5b58da1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.607532 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea78c6-52ce-4603-a036-b2b5b58da1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.608171 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea78c6-52ce-4603-a036-b2b5b58da1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:25.609809 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea78c6-52ce-4603-a036-b2b5b58da1a2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:25.622066 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1301/2590] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:25.625943 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627fba5-8e67-434b-95ba-febecdc6e1c8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:25.635618 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627fba5-8e67-434b-95ba-febecdc6e1c8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:25.640278 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215e9e-b4c7-417b-9789-c50d2254a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:25.640939 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215e9e-b4c7-417b-9789-c50d2254a46b admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.641303 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215e9e-b4c7-417b-9789-c50d2254a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.641713 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215e9e-b4c7-417b-9789-c50d2254a46b admin admin] PATH_INFO: `/v3/projects/52c0131ba84b4d28a390a20a9d055fcb/users/82fd8888100d4fdfb3754a03b95ff752/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.643976 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:25.658432 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db215e9e-b4c7-417b-9789-c50d2254a46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c0131ba84b4d28a390a20a9d055fcb, user_id=82fd8888100d4fdfb3754a03b95ff752, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:25.661697 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db215e9e-b4c7-417b-9789-c50d2254a46b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:25.674090 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1290/2591] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:32:25 2022] PUT /identity/v3/projects/52c0131ba84b4d28a390a20a9d055fcb/users/82fd8888100d4fdfb3754a03b95ff752/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:25.685776 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f42e-7b5d-42f4-b01a-0a3808865905 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.686062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f42e-7b5d-42f4-b01a-0a3808865905 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.686334 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f42e-7b5d-42f4-b01a-0a3808865905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.713745 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-02a3f42e-7b5d-42f4-b01a-0a3808865905 None None] MFA Rules not processed for user `82fd8888100d4fdfb3754a03b95ff752`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:25.714954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-02a3f42e-7b5d-42f4-b01a-0a3808865905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:25.779257 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1302/2592] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:25.783783 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215e9e-b4c7-417b-9789-c50d2254a46b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:25.844256 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215e9e-b4c7-417b-9789-c50d2254a46b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:25.849424 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f8fa6-bc02-4780-96ca-3d725f039347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:25.850028 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f8fa6-bc02-4780-96ca-3d725f039347 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.850305 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f8fa6-bc02-4780-96ca-3d725f039347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.850580 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f8fa6-bc02-4780-96ca-3d725f039347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.851202 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f8fa6-bc02-4780-96ca-3d725f039347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:25.853128 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f8fa6-bc02-4780-96ca-3d725f039347 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:25.878329 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1291/2593] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:32:25 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:32:25.882421 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3f42e-7b5d-42f4-b01a-0a3808865905 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:25.893574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3f42e-7b5d-42f4-b01a-0a3808865905 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:25.925952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:25.951420 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382cc3d-0091-461a-81f9-15ed883d25fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:25.952025 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382cc3d-0091-461a-81f9-15ed883d25fc admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.952307 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382cc3d-0091-461a-81f9-15ed883d25fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.952579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382cc3d-0091-461a-81f9-15ed883d25fc admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.953214 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382cc3d-0091-461a-81f9-15ed883d25fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:25.955102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382cc3d-0091-461a-81f9-15ed883d25fc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:25.976546 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1303/2594] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:32:25 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:32:25.980748 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f8fa6-bc02-4780-96ca-3d725f039347 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:25.991281 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f8fa6-bc02-4780-96ca-3d725f039347 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:25.996154 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e22c7-6086-42ed-bdca-eb477e1adc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:25.996765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e22c7-6086-42ed-bdca-eb477e1adc5f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:25.997081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e22c7-6086-42ed-bdca-eb477e1adc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:25.997360 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e22c7-6086-42ed-bdca-eb477e1adc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:25.998001 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e22c7-6086-42ed-bdca-eb477e1adc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:25.999675 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e22c7-6086-42ed-bdca-eb477e1adc5f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:26.010241 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1292/2595] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 21 21:32:26.014102 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382cc3d-0091-461a-81f9-15ed883d25fc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:26.024587 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382cc3d-0091-461a-81f9-15ed883d25fc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:26.029131 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16914e-b550-4970-a9fc-d3872386b854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:26.029724 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16914e-b550-4970-a9fc-d3872386b854 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.030003 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16914e-b550-4970-a9fc-d3872386b854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.030274 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16914e-b550-4970-a9fc-d3872386b854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.030916 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16914e-b550-4970-a9fc-d3872386b854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:26.032522 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16914e-b550-4970-a9fc-d3872386b854 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:26.042723 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1304/2596] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:26.046636 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e22c7-6086-42ed-bdca-eb477e1adc5f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:26.056979 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e22c7-6086-42ed-bdca-eb477e1adc5f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:26.061591 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f9ab0-d43b-488c-90c9-6f4efb7ad328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:26.062234 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f9ab0-d43b-488c-90c9-6f4efb7ad328 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.062510 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f9ab0-d43b-488c-90c9-6f4efb7ad328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.062780 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f9ab0-d43b-488c-90c9-6f4efb7ad328 admin admin] PATH_INFO: `/v3/projects/4e7a4d8d2a3f4838904acbdd3ccc0347/users/a2686252cbec4c5c997d40390fe641fe/roles/d446ff7289fd4718a77384fd80873ca4` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.078788 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f9ab0-d43b-488c-90c9-6f4efb7ad328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7a4d8d2a3f4838904acbdd3ccc0347, user_id=a2686252cbec4c5c997d40390fe641fe, role_id=d446ff7289fd4718a77384fd80873ca4)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:26.081474 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f9ab0-d43b-488c-90c9-6f4efb7ad328 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:26.094830 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1293/2597] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:32:26 2022] PUT /identity/v3/projects/4e7a4d8d2a3f4838904acbdd3ccc0347/users/a2686252cbec4c5c997d40390fe641fe/roles/d446ff7289fd4718a77384fd80873ca4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:26.105470 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746394-a6a9-40f5-bd34-41ad9627581c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.105754 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746394-a6a9-40f5-bd34-41ad9627581c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.106024 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746394-a6a9-40f5-bd34-41ad9627581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.133022 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-87746394-a6a9-40f5-bd34-41ad9627581c None None] MFA Rules not processed for user `a2686252cbec4c5c997d40390fe641fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:26.134574 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-87746394-a6a9-40f5-bd34-41ad9627581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:26.197200 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1305/2598] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:26.201823 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f9ab0-d43b-488c-90c9-6f4efb7ad328 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:26.261062 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f9ab0-d43b-488c-90c9-6f4efb7ad328 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:26.265568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4a44a-5e02-41cc-b8a3-68e824b106c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:26.266162 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4a44a-5e02-41cc-b8a3-68e824b106c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.266436 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4a44a-5e02-41cc-b8a3-68e824b106c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.266705 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4a44a-5e02-41cc-b8a3-68e824b106c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.267373 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4a44a-5e02-41cc-b8a3-68e824b106c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:26.269239 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4a44a-5e02-41cc-b8a3-68e824b106c8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:26.294902 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1294/2599] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Oct 21 21:32:26 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 21 21:32:26.298914 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87746394-a6a9-40f5-bd34-41ad9627581c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:26.309458 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87746394-a6a9-40f5-bd34-41ad9627581c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:26.365444 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19edc5-2053-4a55-856c-29033f28dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:26.365977 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19edc5-2053-4a55-856c-29033f28dd40 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.366256 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19edc5-2053-4a55-856c-29033f28dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.366527 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19edc5-2053-4a55-856c-29033f28dd40 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.367145 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19edc5-2053-4a55-856c-29033f28dd40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:26.369060 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19edc5-2053-4a55-856c-29033f28dd40 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:26.390806 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1306/2600] 10.222.0.23 () {60 vars in 1144 bytes} [Fri Oct 21 21:32:26 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 21 21:32:26.395322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4a44a-5e02-41cc-b8a3-68e824b106c8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:26.405323 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4a44a-5e02-41cc-b8a3-68e824b106c8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:26.409879 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de5bf0-b5ca-47b7-bf0a-311c70afb3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:26.410492 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de5bf0-b5ca-47b7-bf0a-311c70afb3ea admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.410769 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de5bf0-b5ca-47b7-bf0a-311c70afb3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.411040 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de5bf0-b5ca-47b7-bf0a-311c70afb3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.411709 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de5bf0-b5ca-47b7-bf0a-311c70afb3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:26.413275 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de5bf0-b5ca-47b7-bf0a-311c70afb3ea admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:26.423851 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1295/2601] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:26.427822 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19edc5-2053-4a55-856c-29033f28dd40 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:26.437681 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19edc5-2053-4a55-856c-29033f28dd40 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:26.442847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a89990-9552-41f8-8ce0-91c14df7cbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:26.443535 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89990-9552-41f8-8ce0-91c14df7cbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.443834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89990-9552-41f8-8ce0-91c14df7cbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.444092 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89990-9552-41f8-8ce0-91c14df7cbd4 admin admin] PATH_INFO: `/v3/projects/f4a78bc5040e4648adf5c71e32d55da1/users/f788c149b2444b158d860b12750249ea/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.459184 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a89990-9552-41f8-8ce0-91c14df7cbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a78bc5040e4648adf5c71e32d55da1, user_id=f788c149b2444b158d860b12750249ea, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:26.461954 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a89990-9552-41f8-8ce0-91c14df7cbd4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:26.473952 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1307/2602] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:32:26 2022] PUT /identity/v3/projects/f4a78bc5040e4648adf5c71e32d55da1/users/f788c149b2444b158d860b12750249ea/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:32:26.477842 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de5bf0-b5ca-47b7-bf0a-311c70afb3ea admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:26.487650 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de5bf0-b5ca-47b7-bf0a-311c70afb3ea admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:26.491151 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:26.545025 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3d31a-d3ef-4db6-8aab-f6312a9fcde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:26.545672 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3d31a-d3ef-4db6-8aab-f6312a9fcde7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.545952 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3d31a-d3ef-4db6-8aab-f6312a9fcde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.546223 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3d31a-d3ef-4db6-8aab-f6312a9fcde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.546849 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3d31a-d3ef-4db6-8aab-f6312a9fcde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:26.548454 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3d31a-d3ef-4db6-8aab-f6312a9fcde7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:26.558456 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1296/2603] 10.222.0.23 () {58 vars in 1122 bytes} [Fri Oct 21 21:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 21 21:32:26.562757 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a89990-9552-41f8-8ce0-91c14df7cbd4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:26.573800 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a89990-9552-41f8-8ce0-91c14df7cbd4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:26.578579 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd211-a54e-413a-a955-2496737dee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:26.579240 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd211-a54e-413a-a955-2496737dee5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.579566 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd211-a54e-413a-a955-2496737dee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.579871 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd211-a54e-413a-a955-2496737dee5b admin admin] PATH_INFO: `/v3/projects/f4a78bc5040e4648adf5c71e32d55da1/users/f788c149b2444b158d860b12750249ea/roles/58b61e8083c64fd58b3eb63efc4c7e3e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.581847 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badd211-a54e-413a-a955-2496737dee5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a78bc5040e4648adf5c71e32d55da1, user_id=f788c149b2444b158d860b12750249ea, role_id=58b61e8083c64fd58b3eb63efc4c7e3e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:26.584513 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badd211-a54e-413a-a955-2496737dee5b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:26.587685 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:26.596637 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1308/2604] 10.222.0.23 () {60 vars in 1483 bytes} [Fri Oct 21 21:32:26 2022] PUT /identity/v3/projects/f4a78bc5040e4648adf5c71e32d55da1/users/f788c149b2444b158d860b12750249ea/roles/58b61e8083c64fd58b3eb63efc4c7e3e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:32:26.606515 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec04b-dc31-47c1-a092-d4fff2ca62c0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.606803 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec04b-dc31-47c1-a092-d4fff2ca62c0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.607080 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec04b-dc31-47c1-a092-d4fff2ca62c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.635319 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a34ec04b-dc31-47c1-a092-d4fff2ca62c0 None None] MFA Rules not processed for user `f788c149b2444b158d860b12750249ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:26.636435 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a34ec04b-dc31-47c1-a092-d4fff2ca62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:26.703056 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1297/2605] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:26.714698 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd211-a54e-413a-a955-2496737dee5b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:26.716718 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6badd211-a54e-413a-a955-2496737dee5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:26.776659 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd211-a54e-413a-a955-2496737dee5b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:26.780265 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e5a44-0bca-4d8a-833a-bd26bef25eee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:26.780866 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e5a44-0bca-4d8a-833a-bd26bef25eee service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:26.781143 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e5a44-0bca-4d8a-833a-bd26bef25eee service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:26.781413 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e5a44-0bca-4d8a-833a-bd26bef25eee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:26.836632 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e5a44-0bca-4d8a-833a-bd26bef25eee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:26.838043 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e5a44-0bca-4d8a-833a-bd26bef25eee service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:26.846733 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1309/2606] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:28.513147 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec04b-dc31-47c1-a092-d4fff2ca62c0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:28.514569 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a34ec04b-dc31-47c1-a092-d4fff2ca62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:28.526993 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec04b-dc31-47c1-a092-d4fff2ca62c0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:28.530542 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eb703-d317-4938-8b21-b9b4b465c1e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:28.531161 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb703-d317-4938-8b21-b9b4b465c1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:28.531478 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb703-d317-4938-8b21-b9b4b465c1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:28.531754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083eb703-d317-4938-8b21-b9b4b465c1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:28.587426 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eb703-d317-4938-8b21-b9b4b465c1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:28.588845 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083eb703-d317-4938-8b21-b9b4b465c1e7 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:28.597502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1298/2607] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:29.127059 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e5a44-0bca-4d8a-833a-bd26bef25eee service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:29.136330 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e5a44-0bca-4d8a-833a-bd26bef25eee service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:29.139896 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bbe09-3864-406a-bd8b-f438b090685e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f812676e6f4b258f556d5a0b54dc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:29.140491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bbe09-3864-406a-bd8b-f438b090685e service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:29.140764 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bbe09-3864-406a-bd8b-f438b090685e service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:29.141033 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bbe09-3864-406a-bd8b-f438b090685e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:29.149834 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bbe09-3864-406a-bd8b-f438b090685e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:29.151291 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bbe09-3864-406a-bd8b-f438b090685e service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:29.160957 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1310/2608] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:33.015322 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eb703-d317-4938-8b21-b9b4b465c1e7 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:33.044512 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:33.078745 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083eb703-d317-4938-8b21-b9b4b465c1e7 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:33.083359 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:33.083939 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:33.084222 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:33.084504 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] PATH_INFO: `/v3/users/82fd8888100d4fdfb3754a03b95ff752` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:33.085617 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82fd8888100d4fdfb3754a03b95ff752)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:33.087563 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:33.133164 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82fd8888100d4fdfb3754a03b95ff752'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.140053 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82fd8888100d4fdfb3754a03b95ff752'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.146957 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82fd8888100d4fdfb3754a03b95ff752'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.158829 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82fd8888100d4fdfb3754a03b95ff752'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.159479 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82fd8888100d4fdfb3754a03b95ff752'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.165786 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1299/2609] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:32:33 2022] DELETE /identity/v3/users/82fd8888100d4fdfb3754a03b95ff752 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:33.170316 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664d67a-0f2b-4754-b799-9e730c63fd09 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:33.170792 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664d67a-0f2b-4754-b799-9e730c63fd09 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:33.170938 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664d67a-0f2b-4754-b799-9e730c63fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:33.190144 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8664d67a-0f2b-4754-b799-9e730c63fd09 None None] MFA Rules not processed for user `03d71d1dd5394b76991f4fa1705c829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 21 21:32:33.191370 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8664d67a-0f2b-4754-b799-9e730c63fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:33.249750 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1311/2610] 10.222.0.23 () {58 vars in 958 bytes} [Fri Oct 21 21:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 21 21:32:33.259554 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:33.260949 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:33.321275 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e797b-d106-421e-96cc-591533a2f345 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:33.325351 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a447a7d-0d17-4228-bc1c-2d1d716acf13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad7ef5b260e4425c93ebbe85570136db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:33.325999 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447a7d-0d17-4228-bc1c-2d1d716acf13 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:33.326280 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447a7d-0d17-4228-bc1c-2d1d716acf13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:33.326553 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447a7d-0d17-4228-bc1c-2d1d716acf13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:33.336195 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a447a7d-0d17-4228-bc1c-2d1d716acf13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:33.337555 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a447a7d-0d17-4228-bc1c-2d1d716acf13 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:33.347003 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1300/2611] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:32:33.606246 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664d67a-0f2b-4754-b799-9e730c63fd09 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:33.607721 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8664d67a-0f2b-4754-b799-9e730c63fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:33.619515 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664d67a-0f2b-4754-b799-9e730c63fd09 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:33.624404 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:33.625045 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:33.625324 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:33.625594 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] PATH_INFO: `/v3/projects/52c0131ba84b4d28a390a20a9d055fcb` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:33.627472 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c0131ba84b4d28a390a20a9d055fcb)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:33.629381 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:33.664839 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:33.678072 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c0131ba84b4d28a390a20a9d055fcb', 'request_id': 'req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.683528 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c0131ba84b4d28a390a20a9d055fcb', 'request_id': 'req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.689511 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c0131ba84b4d28a390a20a9d055fcb', 'request_id': 'req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.702087 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] The token cache is being invalidate because project 52c0131ba84b4d28a390a20a9d055fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:32:33.702371 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.702987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.704471 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1312/2612] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:32:33 2022] DELETE /identity/v3/projects/52c0131ba84b4d28a390a20a9d055fcb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:33.708470 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a447a7d-0d17-4228-bc1c-2d1d716acf13 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:33.718458 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a447a7d-0d17-4228-bc1c-2d1d716acf13 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:33.762135 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:33.775851 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:33.776476 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:33.776784 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:33.777081 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] PATH_INFO: `/v3/users/a2686252cbec4c5c997d40390fe641fe` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:33.778212 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2686252cbec4c5c997d40390fe641fe)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:33.780174 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:33.825099 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2686252cbec4c5c997d40390fe641fe'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.831838 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2686252cbec4c5c997d40390fe641fe'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.839031 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2686252cbec4c5c997d40390fe641fe'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.851819 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2686252cbec4c5c997d40390fe641fe'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.852376 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2686252cbec4c5c997d40390fe641fe'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:33.858057 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1301/2613] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:32:33 2022] DELETE /identity/v3/users/a2686252cbec4c5c997d40390fe641fe => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 21 21:32:34.358752 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:34.360199 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:34.373863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c23fe-f4d4-4afa-b7a1-ded79f16ffc2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:34.431208 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:34.431794 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:34.432071 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:34.432340 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] PATH_INFO: `/v3/projects/4e7a4d8d2a3f4838904acbdd3ccc0347` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:34.433434 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7a4d8d2a3f4838904acbdd3ccc0347)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:34.435372 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:34.481033 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7a4d8d2a3f4838904acbdd3ccc0347', 'request_id': 'req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:34.486510 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7a4d8d2a3f4838904acbdd3ccc0347', 'request_id': 'req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:34.492519 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7a4d8d2a3f4838904acbdd3ccc0347', 'request_id': 'req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:34.509966 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] The token cache is being invalidate because project 4e7a4d8d2a3f4838904acbdd3ccc0347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:32:34.510259 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:34.510887 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:34.512483 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1313/2614] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:32:34 2022] DELETE /identity/v3/projects/4e7a4d8d2a3f4838904acbdd3ccc0347 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:34.516568 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:34.518005 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:34.531370 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f53b9-d67a-4d26-9643-a06c241d8a30 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:34.588620 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:34.589240 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:34.589521 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:34.589797 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] PATH_INFO: `/v3/users/f788c149b2444b158d860b12750249ea` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:34.590909 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f788c149b2444b158d860b12750249ea)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:34.592848 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:34.637396 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f788c149b2444b158d860b12750249ea'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:34.644771 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f788c149b2444b158d860b12750249ea'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:34.652190 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f788c149b2444b158d860b12750249ea'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:34.657484 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:34.666481 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f788c149b2444b158d860b12750249ea'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:34.667124 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f788c149b2444b158d860b12750249ea'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:34.673095 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1302/2615] 10.222.0.23 () {58 vars in 1224 bytes} [Fri Oct 21 21:32:34 2022] DELETE /identity/v3/users/f788c149b2444b158d860b12750249ea => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:34.933592 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:32:34.935026 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:32:34.948744 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33232bf5-3c0e-4dbc-80e5-3f5d665c0cb1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:32:34.997058 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:35.008666 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d71d1dd5394b76991f4fa1705c829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd513512ae6f8409d87349246d0ba49f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:32:35.009301 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:32:35.009597 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:32:35.009863 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] PATH_INFO: `/v3/projects/f4a78bc5040e4648adf5c71e32d55da1` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:32:35.010980 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a78bc5040e4648adf5c71e32d55da1)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:32:35.012908 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:32:35.063491 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a78bc5040e4648adf5c71e32d55da1', 'request_id': 'req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:35.068857 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a78bc5040e4648adf5c71e32d55da1', 'request_id': 'req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:35.075196 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a78bc5040e4648adf5c71e32d55da1', 'request_id': 'req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:35.087619 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] The token cache is being invalidate because project f4a78bc5040e4648adf5c71e32d55da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 21 21:32:35.087904 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:35.088516 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2294c4b6-bdaa-4f50-b3bc-0eff73d43ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 21 21:32:35.089987 dv-cinder-861566-4-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1314/2616] 10.222.0.23 () {58 vars in 1233 bytes} [Fri Oct 21 21:32:34 2022] DELETE /identity/v3/projects/f4a78bc5040e4648adf5c71e32d55da1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 21 21:32:44.669524 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=5,keystone:DELETE=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:32:45.085062 dv-cinder-861566-4-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 21 21:35:12.117832 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 21 21:35:12.119754 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:35:12.191354 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93ebf8-8df1-4127-9f09-8790ca7bba30 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 21 21:35:12.249898 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e57ea-ebae-4a7b-b1b2-b86888b695fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa89e84c708f44c299c728284e33fabf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7964cc909c4f46ef8af4195c66900ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 21 21:35:12.250502 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e57ea-ebae-4a7b-b1b2-b86888b695fb service placement] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 21 21:35:12.250773 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e57ea-ebae-4a7b-b1b2-b86888b695fb service placement] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 21 21:35:12.251043 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e57ea-ebae-4a7b-b1b2-b86888b695fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 21 21:35:12.252765 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b29e57ea-ebae-4a7b-b1b2-b86888b695fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 21 21:35:12.264130 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e57ea-ebae-4a7b-b1b2-b86888b695fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 21 21:35:12.265676 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e57ea-ebae-4a7b-b1b2-b86888b695fb service placement] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 21 21:35:12.275309 dv-cinder-861566-4-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1303/2617] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Oct 21 21:35:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 21 21:35:22.271119 dv-cinder-861566-4-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=58 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}